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INTRODUCTION 


The purpose of this project is to refine a “visual neural network,” combined with a 
mammographic database, and test it for its ability to help radiologists reduce the number of 
benign biopsies in mammographic screening without increasing the number of missed cancers. 
We refer to this as a “mapped database diagnostic system.” The unique features of this system 
are a) its exploitation of a clinically proved database of mammograms for enhanced diagnosis, b) 
automatic selection of highly discriminating mammographic features, and c) a two-dimensional 
“relational map” for enhanced browsing through the mammographic database. 

Year 1 of this project was devoted primarily to retrospective studies and to preliminaiy 
development of the mapped database diagnostic system. A major effort in Year 2 was devoted to 
the design and implementation of a computer architecture of a full-service computer-aided 
diagnostic system. Our objectives in this design included ease of data acquisition and recording, 
sophisticated image manipulation, remote and local database-aided diagnosis, and 
semiautomated reporting. We believe these features of the design will encourage radiologists to 
use the diagnostic system, and will make the system transparent in testing our algorithms for 
computer-aided diagnosis. Years 3 and 4 will be devoted primarily to clinical studies. 

Additional effort in Year 2 was devoted to improving our underlying detection and classification 
algorithms, improving our algorithms for finding and retrieving images that are similar the 
images under study, and integrating our algorithms for classifying masses and 
microcalcifications. 

Another major effort in Year 2 was devoted to acquiring a statistically significant database of 
biopsy-proven mammograms. This work included die negotiation of data-sharing agreements 
with UCLA and the Humphrey Comprehensive Health Center, applying to the Institutional 
Review Boards at UCLA and KDMC for permission to cany out research involving human 
subjects, scanning and digitizing films, checking the accuracy of the data, and entering the data 
in our database. 


BODY 

The following are the tasks approved for our project for Year 2, along with the work that was 
carried out in Year 2 for these tasks. 

Task 3. Collect and organize a database of proven mammographic regions of interest (months 
1-6,12-24) 

a. Collect film mammograms from at least 400 subjects, restricting the lesions to 
microcalcifications and masses. (The masses will include stellate lesions.) Add teaching 
files if possible. Include films from King-Drew Medical Center (KDMC) and from 
University of California at Los Angeles (UCLA), (months 1-2) 

b. Digitize all films on Lumiscan 85 film scanner at a 50-micron pixel width. Save all 
digitized mammograms on compact disc, (month 2) 

c. On each mammogram find one or more lesions, using the advanced lesion detector of 
Task 2. Enclose one or more of these lesions in a 512X512-pixel or a 1024X1024 - 
pixel square. We refer to this square as a region of interest (ROI). (months 3-4) 
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d. Print hard copies of all of the digitized ROIs collected in Task 3c. Each radiologiist 
on this project will partition the ROIs into groups of medically and perceptually 
similar ROIs. Each group will be identified by a medically or visually descriptive 
label. We refer to these as perceptual similarity groups. The radiologists will form a 
consensus on a final grouping and labeling of these groups, (month 5) 

e. Each radiologist will construct a dissimilarity matrix for these groups. Each element 
of this matrix will contain the radiologist’s subjective estimate of the dissimilarity of 
the corresponding two groups on a scale from 0 to 5,0 designating identity, and 5 
designating extreme dissimilarity, (month 5) 

f Label the resulting ROI as one of (mass, calcification, asymmetry, architectural 
distortion) and as one of {benign, malignant), (month 5) 

g. Partition the database of ROIs into D and T, in a manner so that the distributions of 
types of abnormalities and perceptual similarity groups in Z) and T are similar, (month 
6 ) 

h. Expand the collection of digitized film mammograms to 500 subjects, primarily from 
KDMC and UCLA. Include asymmetries and architectural distortions in addition to the 
microcalcifications and masses. Search for and collect mammograms containing 
screening errors associated with interval cancers, as well as mammograms containing 
minimal signs that preceded the observation of interval cancers. Search and collect 
mammograms with minimal signs that did not precede the observation of an interval 
cancer. Repeat the subtasks b to g. (months 12-18) 

i. Explore the possibility of collaborating with other institutions in the sharing of 
mammograms and other medical data related to the early detection of breast cancer. 
With this collaboration and continued acquisitions of proven mammograms from 
UCLA and KDMC, expand the collection of digitized mammograms to 1000 or more. 
Include as many as possible mammograms each of which contains an early sign of a 
cancerous lesion that was missed or misdiagnosed on that mammogram, (months 19- 
24) 

RESEARCH ACCOMPLISHMENTS FOR TASK 3; 

We acquired and organized a database of biopsy-proven mammographic cases from 35 patients 
at the King/Drew Medical Center (KDMC) and 280 cases at the University of California at Los 
Angeles (UCLA). The cases at UCLA covered patients observed during January 1998 to August 
1999. Of these cases 120 were malignant, 20 were high risk benign, and 140 were benign. The 
cases at KDMC covered patients observed during January 2000 to May 2000. Of these cases 3 
were malignant, 2 were high risk benign, and 30 were benign. 

These cases are a significant expansion of our earlier database, which was restricted to a single 
region of interest for each case. Every candidate case for the new database was classified by 
the radiologist in accordance with the BIRADS categories of 0,1,2,3,4, or 5. Only the cases 
receiving BIRADS scores of 4 or 5 were sent to biopsy. Each of these biopsied cases was 
entered into our database, provided the full set of mammograms was found in the case’s film 
jacket. Consequently all of the cases in the acquired database are diagnostic rather than 
screening. Each of these cases was scanned and digitized on our Lumiscan 85 scanner-digitizer, 
and entered into our computer system. Every case included at least two x-ray views of each 
breast (CC and MLO). In addition many of the cases included supplemental images such as 
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MRI, ultrasound and nuclear images (typically with technetium 99 tracers). Every case 
included the outcomes of biopsies. A primary or secondary physician requesting a 
mammographic study referred most of these cases to UCLA or KDMC. 

Among the 35 cases from KDMC, biopsies indicated that 3 were malignant, 2 were high-risk 
benign, and 30 were benign. Among the 280 cases from UCLA, biopsies indicated that 120 
were malignant, 20 were high-risk benign, and 140 were benign. 

Every case in the database included films from earlier years. Thus the 123 malignant cases 
contain films in which the cancers were missed. These cases will enable us to carry out a 
retrospective study that will include an evaluation of the ability of our diagnostic system to 
reduce both the number of missed cancers as well as the number of unnecessary biopsies. 

For the reporting of these cases we designed and used an expansion of the “mammography 
assessment and findings” form described in Addendum H of our proposal. We also adopted a 
list of acronyms (“pathology codes”) to represent the observed pathologies, both benign and 
malignant. The expanded assessment form and the list of pathology codes are presented in 
Appendix 3. 

The data in these cases are stored in three sections. The first section holds the patient medical 
information, such as age, history of breast cancer, incidence of cancer in close relatives, and the 
use of hormones. The second section contains the digitized mammograms and the regions of 
interest (ROIs). The third section contains information that describes the images, such as the 
sizes of the images, the size of the pixel, and the locations of the ROIs in the full mammogram. 

In accordance with part i of this Task, we established a collaboration with the Hubert H. 
Humphrey Comprehensive Health Center (Humphrey Center, for short), using 
telemammography as a means of acquiring additional mammographic screening data and to 
facilitate carrying out the planned prospective tests for evaluating the effectiveness of our 
database-aided diagnostic system. The Hiunphrey Center receives many more mammographic 
screening cases than the King/Drew Medical Center - thereby providing a good population for 
evaluating the effectiveness of our database-aided screening system in reducing the number of 
unnecessary surgical biopsies without increasing the number of missed cancers. This 
collaboration is supported by a grant from the California Telehealth and Telemedicine System. 

Task 4. Construct a graphical user interface for interacting with the two-monitor high- 

resolution display and the control monitor. This graphical user interface will be an 
expansion and refinement of the one-monitor interface shown in the proposal. 

Include a high-resolution simulated square magnifying glass that shows a window 
excised from the 4000 x 5000-pixel array produced by the scanner. Include a 
brightness inversion capability. Include a brightness control and a contrast control, 
(months 14-15) 

RESEARCH ACCOMPLISHMENTS FOR TASK 4; 

We refined and expanded the capabilities of our graphical user interface. These refinements and 
expansions included new commands for the control monitor and for the high-resolution 


6 



monitor. The new commands for the control monitor consisted of a) patient data entry, b) 
image scanning, c) computer-aided diagnosis, and d) computer-aided clinical reporting. The 
new commands for the high-resolution monitor included a) magnification, b) inversion, c) 
brightness control, d) contrast control, e) panning, f) ROI selection, g) zooming, and h) 
selection of views among RMLO, RCC, LMLO, and LCC. 


Task 5. Construct and train a visual neural classifier and a relational map. (months 16-17) 

a. Extract the set of features F2 from the design set D. Use the genetic algorithm G2 to 
find a set of reduced-dimensionality features for analyzing the ROIs. Using these 
reduced-dimensionality features for design set D, construct a database K of labeled 
reduced-dimensionality feature vectors for training the visual neural classifier. 

(month 16) 

b. Construct an initial 5-layer visual neural network and a relational map, based on the 
design principles described in [18-20]. (month 17) 

c. Train this neural network using the design set K to preserve perceptual similarity 
grouping and benign-malignant separation in the relational map. (month 17) 

RESEARCH ACCOMPLISHMENTS FOR TASK 5: 

Classification and detection of masses and microcalcifications require the abnormality to be 
separated from the background. This process is called “segmentation.” During Year 2 we 
designed and implemented a new, substantially improved segmentation algorithm. Continuing 
efforts in this area include the use of genetic algorithms to optimize the selection of the design 
parameters of “active contour models” for the segmentation of masses. 

Our content-based image retrieval (CBIR) algorithm relies on a neural network that learns 
“perceptual similarity” as determined by a radiologist. During Year 2 we enhanced this 
algorithm by including a mutual information component that provides a more stable visual 
representation of the database. Currently the algorithm uses a single view of a lesion as an input 
to the algorithm. We are investigating the possibility of using two views of the breast as an 
input to the algorithm. 

A major property of our diagnostic system is its ability to detect and classify masses and 
microcalcifications. This requires the integration of four principal algorithms: mass detection, 
mass classification, microcalcification detection, and microcalcification classification. Each of 
these principal algorithms consists of several constituent algorithms. The constituent algorithms 
include algorithms for preprocessing, feature extraction, and classification. 

During the past year we designed, built, and carried out preliminary tests of an “application 
server.” The application server contains the system algorithms, including preprocessing, 
feature extraction, detection, and classification. The application server provides a framework 
for integrating the classifiers of microcalcifications and masses. The framework is sufficiently 
general to admit the integration of additional classifiers and imaging technologies, and for the 
refinement of individual algorithms without affecting the other algorithms. In addition the 
framework enables the radiologist to use the algorithms individually or in combination as a 
single system. 
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Task 6. Construct a neurodatabase system, consisting of the graphical user interface, the 
relational map, the visual neural classifier, and the database K. (month 17) 

RESEARCH ACCOMPLISHMENTS FOR TASK 6: 

We constructed a graphical user interface and a computer architecture that will work effectively 
at a remote site, as well as over the internet. The system architecture includes a Java user 
interface, CORBA middleware, an application server to run the classification and detection 
algorithms, and a database consisting of patient’s medical history, the patient’s medical images, 
and verbal and numerical information describing the medical images. This work was reported 
at the 2000 SPIE Meeting on Medical Imaging. A copy of this paper is provided here in 
Appendix 2. 

The Java user interface has five components: a) patient data entry, b) radiologist worklist, c) 
image viewer, d) CAD screen, and e) reporting screen. Each of these components controls a 
distinct aspect of the system. The patient data entry component enables the entry of patient data 
and the digitizing of films. The radiologist worklist component provides a convenient means of 
assigning a distinct list of cases to each radiologist. The radiologist worklist screen also 
provides a convenient means of ensuring patient data security, in accordance with the privacy 
protocols of our Institutional Review Board (IRB). 

The image viewer provides radiologists with several tools to enhance the visibility of 
abnormalities in the displayed mammograms. These tools include magnification of regions of 
interest, zoom in and zoom out, invert the image, change the contrast by adjusting the window 
and level settings, and move the image. Other tools include the selection of regions of interest 
(ROIs) for diagnosis and inclusion in the database. The image viewer also enables the 
radiologist to navigate among various images. For example the radiologist can view the left 
breast images (LCC and LMLO), and then command the system to display the right breast 
images (RCC and RMLO). 

The CAD screen enables computer-aided diagnosis. On this screen the radiologist can view the 
eight ROIs in the database that are most similar to the ROI under study. Each of these eight 
ROIs is prominently marked as either malignant or benign. This screen also enables the 
radiologist to navigate through the entire database to search for images similar to the image 
imder study. 

The reporting screen enables a radiologist to select case descriptors from a comprehensive list 
of descriptors. The system then can print a report for the patient under study. 

In response to a grant from the California Telehealth and Telemedicine Center (CTTC) to 
establish a telemammography system, we constructed CORBA middleware to enable remotely 
sited database-aided diagnoses. In this system, a radiologist at a remote site uses a centrally 
sited database as aid to diagnosis. 

Our diagnostic system was demonstrated at infoRAD 2000, which was a section of the Annual 
Meeting of the Radiological Society of North America (RSNA) in November 2000. The RSNA 
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awarded our exhibit a Certificate of Merit for its “excellent content” and its “educational 
effectiveness.” 

With the assistance of the grant from the CTTC, we developed a plan to test our database-aided 
diagnostic system remotely at the Humphrey Telehealth and Telemedicine Center. Since our 
diagnostic system is not approved for clinical use by the U.S. Food and Drug Administration 
(FDA), we developed a protocol for this test that would safeguard patients’ safety in the face of 
possible errors by the diagnostic system. A copy of this protocol is in Appendix 4. 

Task 7, Retrospective test, (months 18-26) 

a. Using the data set obtained in Task 3a, carry out a test of the neurodatabase system 
with the five- radiologist reading panel in the computer-aided orientation described in 
the Proposal Body (months 18-19) 

b. Modify the neurodatabase system and revise the test set to accommodate the 
expanded database produced by Task 3h, following the procedures of Task 5. In the 
revised test set do not include any members of the test set of Task 7a. Using the 
revised test set and modified neurodatabase system, carry out a test with five 
radiologists in the computer-aided orientation described in the Proposal Body, 
(months 20-24) 

c. Using the modified test set and modified neurodatabase system, carry out a test with 
four radiologists in the radiologist-aided orientation described in the Proposal Body, 
(months 30-31) 

POSTPONEMENT OF TASK 7: 

A temporary shutdown of all IRB-approved research at Drew University in July 2000 imposed a 
delay in carrying out Task 7. While waiting for this approval we developed an enhanced 
architecture for our diagnostic system, which we described above in “Research 
Accomplishments for Task 6.” We plan to carry out Task 7 in Year 3. 

RELEVANCE OF THE THIS WORK TO THE ORIGINAL HYPOTHESIS. 

The following is our original hypothesis: Compared to an unaided radiologist a neurodatabase 
diagnostic system assisting a radiologist in mammographic screening can significantly reduce 
both the incidence of negative biopsies as well as the incidence of missed cancers. 

The published paper (provided in Appendix 1) shows the validity of this hypothesis when the 
image data are restricted to regions of interest containing either microcalcifications or normal 
tissue. 
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KEY RESEARCH ACCOMPLISHMENTS 


We expanded and refined our software for classifying microcalcifications and masses 

• We acquired and organized a database of proven mammographic cases from 45 patients 
at the King/Drew Medical Center (KDMC) and 280 cases at the University of 
California at Los Angeles (UCLA). 

• We refined and expanded the capabilities of our graphical user interface. 

• We designed, built, and carried out preliminary tests of a framework for integrating the 
classifiers of microcalcifications and masses. 

• We constructed a graphical user interface and a computer architecture that will work 
effectively at a remote site, as well as over the internet. 

• We designed and constructed a platform-independent architecture for multisatellite 
remotely aided diagnosis of mammograms. 


REPORTABLE OUTCOMES 
Manuscripts, abstracts, articles, presentations: 

J. Sklansky, Eric Y. Tao, M Bazargan, C.J. Omes, R.C. Murchison, S. Teklehaimanot, “Computer- 
Aded, Case-Based Diagnosis of Mammographic Regions of Interest Containing 
Microcalcifications,” Academic Radiology, Vol. 7, No. 6, June 2000, pp. 395-405. 

Jack Sklansky, EngScD, Chester J. Omes, MS, “Database-Aided Diagnosis in Digital 
Mammography," infoKAD Exhibit, 2000 Annual Meeting of Ihe Radiological Society of North 
America, November, 2000. 

Chester Omes, Daniel J. Valentino, Hong-Jun Yoon, Jack I. Eisenman, Jack Sklansky, “A Search 
Engine for Remote Database-aided Interpretation of Digitized Mammograms,” Proceedings of 
SPIE 2000, 

Chester Omes, MS; Hong-Jun Yoon, MS; J. Sklansky, EngScD, exhibit of “Computer-Aded 
Interpretation of Mammograms,” at I AM WOMAN conference on women’s health, June 9,2001, 
Irvine, California. 

Award received: 

Jack Sklansky and Chester Omes received a Certificate of Merit for their infoRAD Exhibit on 
“Database-Aded Diagnosis in Digital Mammography" at the Aimual Meeting of the Radiological 
Society of North America, November, 2000. 

Funding based on work supported by this project: 

“Database-Aded Telemammography,” grant of $115,000 from California Telehealth and 
Telemedicine Center, for the period April 1,2000 to June 30,2002. Project Director: Jack 
Sklansky, EngScD. 
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Employment or research opportunities applied for and/or received on experiences/training 
supported by this award: 

Famoosh Nooryanni, MD, received and accepted an offer of a residency in Radiology at the 
University of Southern California with the help of her experience as a Radiology Fellow on our 
project. This appointment will began in July 2001. 

Yvette Price, MD, received and accepted an appointment as a Radiology Fellow at the UCLA his 
Cantor Center for Breast Imaging, beginning in July 2001. Dr. Price was a Radiology Resident and 
participated in our project’s research at the time that she applied for this Fellowship. She passed 
the Radiology Board Examination in 2001. 

Ramin Poursani, MD, received and accepted an appointment as a Resident in Family Medicine at 
the University of Texas, San Antonio, beginning in July 2001. Dr. Poursani was a Radiology 
Fellow in our research project at Ihe time that he applied for this Residency. 

CONCLUSIONS 

Our diagnostic system has advanced from a system restricted to a single region of interest, and 
with the lesions within each region of interest restricted to microcalcifications to a system in 
which more than one region of interest may be associated with each case, and in which the 
surrounding parenchymal tissue may be taken into account. 

Our design of a platform-independent architecture for multisatellite remotely sited diagnosis of 
mammograms coupled with our enhanced ability to find similarities among multi-mammogram 
cases shows promise of contributing to the development and growth of multisatellite 
teleradiology. 

Our advances in the development of JAVA-based image processing and image retrieval 
architectures on PC platforms enhances our ability to realize our diagnostic system with low-cost 
PC computers in conjunction with state-of-the-art high-resolution radiological monitors. 
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Original Investigations 




Computer-aided, Case-based Diagnosis 
of Mammographic Regions of Interest 
Containing Microcalcifications^ 

Jack Sklansky, EngScD, Eric Y. Tao, PhD, Mohsen Bazargan, PhD 
Chester J. Ornes, MS, Robert C. Murchison, MD, Senait Teklehaimanot, MPH 


Rationale and Objectives. The purpose of this study was to evaluate the effectiveness of a mapped-database diagnostic sys¬ 
tem in reducing the incidence of benign biopsies and misdiagnosed cancers among mammographic regions of interest (ROIs). 

Materials and Methods. A novel neural network was devised {a) to respond to a query ROI by recommending to biopsy or 
not to biopsy and {b) to map each ROI in the database as a dot on a computer screen. The network was designed so that clus¬ 
ters in the array of dots help the radiologist to find proved ROIs visually similar to the query ROI. This mapped-database diag¬ 
nostic system was restricted to ROIs with visible microcalcifications. The neural network was trained with a stored database of 
80 biopsy-proved ROIs. 

Results. Four radiologists acting independently on 100 ROIs recommended biopsies for 18, 15, 28, and 18 benign ROIs and 
misdiagnosed cancers in 11, 12, 7, and eight ROIs, respectively. Interaction with the mapped-database system reduced the 
numbers of benign biopsies to 11, eight, 18, and 10 cases and of misdiagnosed cancers to eight, seven, four, and three cases, 
respectively. Statistical analysis indicated that three radiologists achieved significant improvements at P < .02 and the fourth 
achieved a substantial improvement at P < .07. 

Conclusion. By using a mapped database of proved mammographic ROIs containing microcalcifications, radiologists may 
statistically significantly reduce the numbers of benign biopsies and misdiagnosed cancers. 

Key Words. Computer-aided diagnosis; digital mammography; microcalcifications. 


A critical aspect of mammographic diagnosis is deciding 
whether to recommend biopsy. Approximately two benign 
lesions are sampled for biopsy for every malignant lesion 
detected (1). In a recent study of 2,400 women undergoing 
mammographic screening during a 10-year period (2), an 
additional $33 was spent on evaluating false-positive re- 


Acad Radiol 2000; 7:395^05 

^ From the Department of Radiology, Charles R. Drew University of Medicine 
and Science. Los Angeles, Calif (J.S., M.B., R.C.M., S.T.); the Institute for 
Communication Science and Technology, California State University, Mont¬ 
erey Bay (E.Y.T.); and the Department of Electrical and Computer Engineer¬ 
ing, University of California. Irvine (J.S., C.J.O.). Supported in part by the 
California Breast Cancer Research Program of the University of California 
(grant 3IB-0011), the U.S. Army Medical r4esearch and Materiel Command 
(grant DAMD17-99-9118), and the Research Centers in Minority Institutions 
Award (RR-03026) from the National Center of Research Resources, Na¬ 
tional Institutes of Health. Received November 28,1999; revision requested 
February 8,2000; revision received and accepted February 28. Address cor¬ 
respondence to J.S., 43 Cambria Dr, Corona del Mar, CA 92625-1004. 
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suits for every $100 spent on screening. Among the women 
in that study, the cumulative risk of a false-positive result 
after 10 mammograms was 49.1%. Thus, it would be highly 
desirable to reduce the frequency of benign biopsies doiiilg 
mammographic screening without increasing the number of 
missed cancers. 

The objective of this study was to evaluate the effective¬ 
ness of a recently devised “mapped-database diagnostic 
system” in reducing the frequency of benign biopsies and 
misdiagnosed cancers among mammographic regions of 
interest (ROIs). The principal difference between this sys¬ 
tem and earlier computer-aided diagnostic systems for mam¬ 
mography is the facilitation of diagnostic reasoning by a 
database of proved ROIs. In this study, the presented mam¬ 
mographic images and stored database are restricted to ROIs, 
and the ROIs themselves are restricted to those revealing 
apparent microcalcifications. 

Interpretation of mammograms consists of two major 
components: detection and diagnosis. In detection, the 
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radiologist typically examines four full-field views—two 
views of each breast. In these views, the radiologist may 
detect one or more ROIs revealing possible lesions. In diag¬ 
nosis, the radiologist analyzes one or more ROIs to deter¬ 
mine whether biopsy should be performed or whether the^ 
patient should be recalled for further examination. Thus, 
analysis of ROIs is an important part of clinical mammogra¬ 
phy, particularly in establishing a diagnosis. This study fo¬ 
cused on the ability of the mapped-database diagnostic sys- 
teni to reduce the number of negative biopsy results and of 
misdiagnosed cancers associated with the analysis of ROIs. 

By restricting the images used in this study to ROIs, 
thereby excluding the fiill-breast views, we reduced much 
of the cost and duration of the experiments, but at the ex¬ 
pense of eliminating contextual evidence. A further reduc¬ 
tion in cost—and in diagnostic accuracy—was obtained by 
replacing film mammograms with digital images displayed 
with a cathode ray tube monitor (3). By anticipating the wide¬ 
spread growth of digital mammography while recognizing 
these reductions in diagnostic accuracy, this relatively inex¬ 
pensive study examined the effect of the mapped-database 
system on diagnostic accuracy during digital mammography. 

In the mapped-database system, an artificial neural net¬ 
work responds to a mammographic ROI by recommending, 
or not recommending, biopsy. In addition, the neural network 
maps a database of ROIs from proved mammograms onto a 
two-dimensional display as an aid to establishing a diagnosis. 
The network does this by mapping each ROI into a dot on a 
screen and arranging these dots so that they cluster into radio¬ 
graphically similar subclasses. We refer to this representation 
as a mapped database. In addition to producing the mapped 
database, the neural network partitions the screen into two de¬ 
cision regions: one for a biopsy being recommended, and the 
other for a biopsy not being recommended. We call the result¬ 
ing display a relational map (4). By annexing this neural net¬ 
work to a means of quickly retrieving and viewing ROIs that 
are mapped close to the query, the radiologist is given a 
simple way of conversing with the database to enhance the 
reliability of the diagnostic decision. Thus, this system ampli¬ 
fies the radiologist’s powers of “case-based reasoning” (5) 
and acts somewhat like a second reader with consensus (6). 

This concept led to construction of a mammographic di¬ 
agnostic system built on the basis of several earlier devel¬ 
opments: {a) algorith ms for de tecting and analyzing clus¬ 
ters of microcalcifications (7-10),^jb) large databases of 
digitized mammograms (11-15), (c) genetic algorithms for 
high-speed, parallel search (16), and {d) “visual neural clas¬ 
sifiers” (ie, specialized neural networks) that map multidi¬ 
mensional features and multidimensional decision surfaces 


onto two-dimensional displays (4). We refer to this as a 
mapped-database diagnostic system. The test results re¬ 
ported herein suggest that for mammograms with detectable 
microcalcifications, this system can provide a new level of 
reliability for mammographic diagnosis. 

The most pertinent earlier work regarding database-aided 
mammographic diagnosis is that by Swett and his colleagues 
at Yale University (17). Their mammographic database sys¬ 
tem, MAMMO/ICON, required a verbal medical history and 
Verbal mammographic descriptors to supplement each m^- 
mogram. This system could provide diagnostic advice that 
depended on semantic similarities of the verbal descriptors 
and medical histories (18). A shortcoming of this technology, 
however, was its dependence on verbal descriptors to match 
information that was essentially pictorial and nonverbal. 
Among radiologists, there may be considerable variability in 
the specific words used to describe the pertinent properties 
of ^y given manimogram. This variability may impair the 
reliability of retrieving similar mammograms filed according 
to verbal descriptors. Another shortcoming was the manual 
construction of the verbal descriptors for the mammograms, 
in contrast to the possibility of automatic extraction and 
counting of key words in text. 

Among other published articles on computer-aided diag¬ 
nosis of mammograms, those by Getty et al (19), Jiang et al 
(9), and Chan et al (20) are particularly relevant to the pres¬ 
ent work. Getty et al (19) demonstrated that a checklist of 
descriptors (ie, “features”) combined with a digital classifier 
could be an effective aid in establishing the diagnosis during 
mammography. These features, as in our experiment, were 
for the most part descriptors of a “focused abnormality” (ie, 
the equivalent of ROI as used here). The protocol for aiding 
the radiologist included a computer-alone reading, which was 
followed with a second reading by the radiologist (analogous 
to a double reading with consensus). A second contribution 
by Getty et al was the demonstration that a carefully selected 
set of features, when coupled with a session to train radiolo¬ 
gists to estimate these features, could enable computer-aided 
generalists to read film mammograms almost as well as 
highly skilled specialists. Jiang et al (9) demonstrated the 
potential of automatically extracting features from microcal¬ 
cifications, coupled with an artificial neural network, for 
computer-aided diagnosis. The methods in both of these 
studies (9,19), however, still required substantial human in¬ 
volvement in the computer-aided procedure. In the method 
of Getty et al (19), each radiologist estimated the numeric 
level of intensity or level of confidence for the existence of 
each feature; in the method of Jiang et al (9), the location of 
each microcalcification was determined manually. This 
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amount of human involvement likely makes these techniques 
impractical for clinical use. 

Chan et al (20) restricted human involvement to identi¬ 
fying in each view an ROI enclosing a mass. This level of 
human involvement is likely to be practical during clinical 
applications, because finding ROIs is part of the usual pro¬ 
cedure for interpreting mammograms. As in the method of 
Getty et al (19), the radiologist-reader in the method of Chan 
et al ( 20 ) was asked to make a final estimate regarding the 
likelihood of malignancy in a presented mammogram after 
first performing an unaided estimation and then receiving 
the computer’s estimate. In that study, the performance of 
the computer alone was comparable to that of the best per¬ 
forming unaided radiologist-reader and to the performance 
of six aided radiologist-readers as a group. 


MATERIALS AND METHODS 


A retrospective study of the mapped-database system was 
performed during June 1998. The ROIs included in this 
study were restricted to those exhibiting microcalcifications. 
For this study, we acquired a database of 200 ROIs from 138 
proved cases. Biopsy results were included with each ROI. 
Four radiologists from the clinical faculty of the Department 
of Radiology at King/Drew Medical Center (KDMC) read 
the digitized images in this study. None of these radiologists 
was familiar with the cases, and all of them were certified for 
mammography by the U.S. Food and Drug Administration. 
Their postresidency experience in reading mammograms 
was 29 years, 10 years, 5 years, and 6 months; these readers 
are referred to as Rj, R^, R 3 , and R^, respectively. 

The ROIs in the database were excised from digitizations 
of film mammograms provided by KDMC and by the Univer¬ 
sity of California at Los Angeles (UCLA) Iris Cantor Center 
for Breast Imaging. In all cases associated with these mammo¬ 
grams, either biopsy or follow-up with subsequent mammog¬ 
raphy was performed. From these mammograms, all 138 cases 
that revealed microcalcifications were selected for this study. 
Fifty-two cases were from KDMC, and 86 were from UCLA. 
The selected mammograms were digitized at KDMC on a 
scanner-digitizer (Lumiscan 85; Lumisys, Sunnyvale, Calif) 
at a pixel width of 50 |uim and a pixel depth of 12 |Xm. 

For each film mammogram, the location of an abnor¬ 
mality containing a cluster of microcalcifications was pro¬ 
vided in the medical record that accompanied the image. 
From this information, we constructed a 512 x 512-pixel 
ROI enclosing each designated cluster of microcalcifica- 
tions. This construction yielded 160 ROIs. No two ROIs in 
this set were views of the same lesion. To each ROI we ap¬ 


plied an automatic microcalcification detector and segmeriter 
that was developed during an earlier study (7). An additional 
40 normal ROIs were also added to this database, thereby 
making a total of 200 ROIs in this study. These normal ROIs 
were included to ensure that readers would have the impr^- 
sion that not all ROIs in the set used to test the system (de¬ 
scribed later) were abnormal. The normal ROIs were ob¬ 
tained from cases involving patients who did not undergo 
biopsy and were not recalled during a period of at least 18 
months. Within each of these cases, the normal ROI was 
selected arbitrarily. 

Of the abnormal ROIs (ie, those containing microcalcifi¬ 
cations), 64 were proved at biopsy to be benign, 49 were 
proved at biopsy to be malignant, and 47 were proved at fol¬ 
low-up to be benign (ie, both the ROI and the follow-up 
findings did not produce a recommendation for biopsy). At 
least 18 months elapsed between two successive examina¬ 
tions, and none of the radiologists on our reading panel had 
seen these ROIs before this study. One radiologist (R^) parti¬ 
tioned the 200 ROIs into groups such that ROIs in the same 
group were visually similar. We refer to these groups as per¬ 
ceptual groups. No restriction was placed on the number of 
perceptual groups, although the radiologist (R^) was in¬ 
formed that eight groups were formed by another radiologist 
during another set of ROIs in an earlier experiment (21). The 
radiologist (Rj) partitioned the 200 ROIs into the following 
12 groups: {a) amorphous with mass, Q?) lobular and ductal, 
(c) amorphous, {d) pleomorphic and scattered, {e) lobular, 

(/) granular, (g) casting, {h) punctate scattered, (i) linear duc¬ 
tal, (/) vesicular, (k) oil cyst, and (/) no visible abnormality. 

Computer-aided reading of the test set by the reading 
panel was performed more than a month after partitioning of 
the ROIs into perceptual groups. The intent of this 1-month 
delay was to suppress the memory of ttie 200 ROIs in-4ie-ra- 
diologist who partitioned them into the perceptual groups. 

The database was then divided into two sets, D and T, each 
of which consisted of 100 ROIs. D was used for the design of 
the diagnostic system, and T was used for testing of the sys¬ 
tem. The 160 abnormal ROIs were randomly partitioned 
several times into two equal parts, and until a (D^, 
pair was found such that and each contained at least two 
ROIs from each perceptual group. (Ensuring representation 
of at least two ROIs from each perceptual group, however, 
may have biased the diagnostic system somewhat in favor of 
the neural network. On the other l/and, not achieving this rep¬ 
resentation would have biased the study against the neural 
network.) consisted of 54 benign and 26 malignant ROIs. 

consisted of 57 benign and 23 malignant ROIs. Because no 
two ROIs were images of the same lesion, all lesions in T 
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fable 1 

Features Extracted from Microcalcifications and Regions of Interest 

Feature 

Symbol 

Formula 

Clinical Importance 

Area 

A 

Number of pixels in the calcification labeled > 0 

Large calcification may suggest a benign 
abnorriiality. 

Perimeter 

P 

Number of pixels In central boundary (label = 0) 

Large calcification may suggest a benign 
abnormality. 

Irregularity 

1 

A/P2 

Irregular boundary may suggest a malignant 
abnormality. 

Mean intensity 

Ml 

Average brightness of pixels labeled > 0 

Bright calcification may suggest a benign 
abnormality. 

Standard deviation 
of intensity 

SI 

Standard deviation of pixels labeled > 0 

Large S/ may suggest an irregular density 
and malignancy. 

Mean of exterior 
intensity 

ME 

Average brightness of pixels within 5 pixels from 
the calcification 

Large ME may suggest a dense and malig¬ 
nant tissue. 

Standard-deviation of 
exterior intensity 

SE 

Standard deviation of pixels within 5 pixels from 
the calcification 

Large SE may suggest a malignant tissue. 

Contrast 

C 

\MI - Sl\ - Ml 

Large contrast may suggest a benign abnor¬ 
mality. 

Sharpness of 
boundary 

SH 

Average change in brightness between pixels 
labeled 0 or 1 and those labeled -1 or -2 

Large SH may suggest a benign abnormality. 

Inner shell contrast 

B, 

Average change in brightness between pixels 
labeled 2 and those labeled 1 

Large may suggest a benign abnormality. 

Center shell contrast 

Bo 

Average change in brightness between pixels 
labeled 1 and those labeled 0 

Large B^ may suggest a benign abnormality. 

Outer shell contrast 

B_, 

Average change In brightness between pixels 
labeled 0 and those labeled -1 

Large B_^ may suggest a benign abnormality. 

Exterior shell contrast 


Average change in brightness between pixels 
labeled -1 and those labeled -2 

Large B,^ may suggest a benign abnormality. 

Concavity index 

Cl 

Area of region between the calcification and its 
convex hull 

Large Cl may suggest a malignancy. 

Shape signature 

SG 

where ris radial distance 

of boundary from centroid, R is the mean of r, 
and 0 is orientation of r 

A large SG may suggest benign tissue. 

Aspect ratio 

R 

Ratio of maximum central diameter to minimum 

central diameter 

Large R may suggest a malignancy. 

Count 

N 

Number of calcifications 

Large count may suggest malignancy. 

Structural index 

S 

dyj{N!AC) , where dis the average dis¬ 
tance of the closest calcification and AC is 
area spanned by cluster 

Large S indicates nonuniform distribution of 
microcalcifications and, hence, may 
suggest malignancy. 


were distinct from aD lesions in Z). The 40 normal ROIs were 
partitioned several times into two equal parts, and until 
a pair was found such that and 7^ had^similar dis¬ 

tributions in the mapped feature space. Tlie final design set D 
was the union of and The final test set T was the union 


of and These procedures were performed to ensure the 
design set was representative of the types of abnormalities oc¬ 
curring in the test set. As mentioned, the normal ROIs were 
included to ensure the readers would have the impression that 
not all ROIs in T were abnormal. Because diagnostic (rather 
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Figure 1. Numeric labeling for the pixels of a digital model repre¬ 
senting a typical microcalcification. The label of each pixel is the 
number of pixel displacements of that pixel from the medial axis of 
the boundary of the microcalcification. Thus, 0 denotes a pixel on 
the medial axis of the boundary, 1 a pixel just inside the boundary, 
-1 a pixel just outside the boundary, and -2 a pixel just outside 
the -1 region. 

than detection) efficacy was paramount in this study, the 
mapped-database system in this study was designed to ana¬ 
lyze only the abnormal ROIs. Consequently, readings of the 
normal ROIs were not included in our calculations of speci¬ 
ficity, sensitivity, and other measures of performance. 

From each abnormal ROI, 18 candidate features were ex¬ 
tracted. Each candidate feature was designed to reflect one or 
more properties of calcifications (or groups of calcifications) 
that are meaningful to the radiologist. These features were 
based on the American College of Radiology’s Breast Imag¬ 
ing Recording and Data System (BI-RADS) descriptors for 
interpreting mammograms, the book by Lanyi (22), and dis¬ 
cussions with the radiologists on our panel. Unfortunately, 
most BI-RADS descriptors are too subjective for encoding 
into computer-executable formulas. Consequently, the fea¬ 
tures we extracted were inspired by, but not necessarily a di¬ 
rect implementation of, the BI-RADS descriptors. A formula¬ 
tion and brief clinical justification for each of these features 
are given in Table 1, In the first two columns of this table, a 
name and a mathematical symbol denote each feature. A for¬ 
mula for each feature is given in the third column. The fourth 
column contains a brief description of the clinical importance 
of the feature. Some of the formulas refer to numerical pixel 


labels -2, -1,0, and 1. The label on each pixel P is the num¬ 
ber of pixel displacements of P from the boundary of a calci¬ 
fication. The label 0 denotes a pixel on the boundary, 1 de¬ 
notes a pixel just inside the boundary, -1 denotes a pixel just 
outside the boundary, and -2 denotes a pixel just outside the 
-1 region. These labels are illustrated in Figure 1, which 
shows a digital model of a typical microcalcification. 

Starting from this set of candidate features, a genetic al¬ 
gorithm searched for those subsets of features that were most 
effective in discriminating malignant from benign cases in 
the database. This algorithm was designed in accordance 
with the genetic feature selector described by Siedlecki and 
Sklansky (23). In this algorithm, each candidate subset is 
represented by a binary string (ie, a sequence of Os and Is). 
The value (0 or 1) of the nth element of the string indicates 
whether the nth feature belongs to the candidate subset. We 
refer to this string as a chromosome. A population of 100 
chromosomes was transformed by an evolutionary process 
consisting of mutation, mating, and reproduction to form a 
sequence of new populations or “generations” under the 
guidance of a penalty function that accounted for the it-near- 
est-neighbor discriminability of the feature vectors in each 
feature subset and for the number of features in the subset. 
The sizes of the new populations were kept constant at 100. 
This evolutionary process also optimized the value of k. To 
ensure an acceptably low rate of misdiagnosed cancers, the 
penalty function gave seven times as much weight to misdi¬ 
agnosing a cancer as to recommending a biopsy that was 
benign. (The weight was chosen empirically so that the 
nearest-neighbor classifier would produce only one or two 
missed cancers on the data set.) This algorithm selected 
the following four features: {a) mean area, {b) mean as¬ 
pect ratio, (c) mean irregularity (ie, noncircularity), and 
(d) number of microcalcifications. Another algorithm ex¬ 
tracted these four features from each ROI, thus forming a 
four-dimensional feature vector as a descriptor of that ROI. 

A five-layer neural network was constructed in accor¬ 
dance with the architecture and the design principles de¬ 
scribed by Omes and Sklansky (24). Each node in this archi¬ 
tecture represented an artificial neuron that consisted of a 
weighted summation followed by a sigmoidal activation 
function. The first layer consisted of four input neurons, one 
for each selected feature. The second and third layers con¬ 
sisted of three and two neurons, respectively, to reduce the 
dimensionality of feature space. The two-neuron layer pro¬ 
duced X and y coordinates (one from each of the two neu¬ 
rons) to represent each ROI as a dot on a relational map. For 
each ROI in the design set, this dot was labeled to indicate 
whether the biopsy was benign or malignant. The two 
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neurons in the fifth layer classified each feature vector as 
either “biopsy recommended” or “biopsy not recom¬ 
mended ” (The neuron producing the larger of the two out¬ 
puts determined the class of the feature vector.) By entering 
every permissible pair of map coordinates at the input to the 
fourth layer, the fifth layer thus produced a relational map 
in which all pixels were labeled as either biopsy recom¬ 
mended or biopsy not recommended. 

Using the four features selected by the genetic algorithm, 
the neural network was trained by backpropagation (ie, a 
form of gradient descent in the space formed by the weights 
at the inputs to the neurons) on the design set D^, thereby pro¬ 
ducing the trained neural network NN(D^) (4). In accordance 
with our design philosophy for this study, the neural network 
was trained only on abnormal ROIs. The biopsy outcomes 
(ie, beni^ and malignant) in the database were the desired 
output classes in the trained neural network, which produced 
a two-dimensional map of and a near-optimal partition of 
this map into two decision regions. These decision regions 
were associated with the decisions of biopsy recommended 
and biopsy not recommended. The training was stopped 
when the mean square error converged to a nearly constant 
value. This design strategy, and the relatively low error rate of 
the neural network on the test set 7, encouraged us to believe 
that the network was then adequately trained. 

The boundary separating the decision regions is referred 
to as a decision curve. The decision curve is substantially 
smoother than the variability of the data, which is the result 
of the averaging produced by the backpropagation training 
and the small number of neurons compared with the number 
of feature vectors in the training set. The neural network 
tends to produce decision regions that are responsive to sta¬ 
tistical models of the training data rather than to the training 
data itself. Specifically, the training algorithm minimized a 
weighted sum-of-squared-error function, which yielded out¬ 
puts that were estimates of Bayesian posterior probabilities 
that the input vector belonged to the corresponding class (ie, 
biopsy recommended or biopsy not recommended). Thus, 
the decision curve produced by the neural network tends to 
“generalize” the training data and, thereby, to make good de¬ 
cisions on future data not included in the training set (25). 

The trained neural network displayed the query and the 
ROIs in as dots, with each dot being located by the x and 
y coordinates produced by the two neurons (one coordinate 
from each neuron) at the two-neuron layer of the network. 

We refer to the space spanned by x and y as the mapped fea¬ 
ture space and to the map of as a mapped database. The 
map of and its decision regions are depicted in Figure 2. 
We call this a relational map. Here, the black region repre- 



Figure 2. Relational map of design set D and the query ROI. Each 
malignant case is labeled X, and each benign case is labeled O. 
The query ROI is labeled ■. 


sents biopsy recommended, and the white region represents 
biopsy not recommended. The decision curve is the bound¬ 
ary between the black and the white regions. The symbols O 
and X denote benign and malignant feature vectors, respec¬ 
tively. The symbol ■ denotes a query. 

A weakness of the mapped-database system is that it does 
not reveal the quantitative relationships between the mapped 
feature space and the unmapped features. This weakness is 
compensated for, however, by the ability of the relational 
map to cluster visually and diagnostically similar ROIs and 
by the map’s representation of a multidimensional decision 
surface as a decision curve (or as several disjoint decision 
curves) in the mapped feature space. The clustering helps the 
radiologist to find ROIs that are visually similar to the query, 
and the decision curve helps the radiologist to determine the 
confidence of the neural network in its recommendations ei¬ 
ther for or against performing biopsy. Further insight into 
the relationships between the mapped feature space and the 
original features can be obtained by making available the nu¬ 
merical values of the original features of each mapped ROI 
to the radiologist-user. 

The user interface presented on the computer monitor is il- 
lusrxated in Figure 3. This interface guides the radiologist-user 
through the steps of diagnosis. Identification numbers in this 
figure (eg, 0^318) were constructed so that patients could not 
be identified from the information in the figure. The mammo- 
graphic image in the upper left is an enlargement of the ROI 


400 




Academic Radiology, Vol 7, No 6, June 2000 


COMPUTER-AIDED DIAGNOSIS OF MAMMOGRAPHIC REGIONS 




Imso* Shown: 011118 








li:;:' Fi r-T-^ m 

MRUtkin J, f 


fS 



-—- 

3 223ls<321M«) 1 


10:09104 

Biopsy; 

Benign 

|jSlSi3:3'4'"240ri (27S^20) 


10:09104 

Biopsy: 

Benign 



Figure 3. User interface for mammographic diagnosis. 


of a query mammogram. Digital magnification and negative- 
to-positive inversion were provided as options on the user in¬ 
terface. In response to a prompt from the interface, the radi¬ 
ologist first determines an “unaided” diagnosis of this ROI and 
reports it in the BI-RADS code (26) by clicking N, B, P, S, or 
M, which denote normal, benign, probably benign, suspicious 
(possibly malignant), and almost definitely malignant, respec¬ 
tively, In this study, we assumed that N, B, and P corresponded 
to biopsy not recommended and that S and M corresponded to 
biopsy recommended. This assumption conformed to the clini¬ 
cal practice at KDMC. We instructed each reader to produce 
the unaided diagnosis as if it were the final diagnosis for the 
examination. No time limit was imposed on this diagnosis. 

In this study, the diagnostic process began by establish¬ 
ing an unaided diagnosis, which was followed immediately 
by establishing an aided diagnosis (analogous to double 
reading). We assumed that the operating point (ie, the sub¬ 
jective decision threshold for a BI-RADS symbol) of the 
unaided radiologist might be affected by that radiologist’s 
anticipation of an aided diagnosis, but that the receiver op¬ 
erating characteristic (ROC) of the unaided diagnosis was 
unaffected by that anticipation. 

Immediately after the unaided diagnosis was established, 
the relational map was presented to the radiologist. This map 
contained the mapped database, mapped query, and distinc¬ 
tively colored decision regions. Thumbnail images of six 


ROIs near the query in the mapped feature space were pre¬ 
sented at the right of the monitor screen. From these images, 
the radiologist retrieved for review those with a visual appear¬ 
ance that seemed to be most similar to that of the query. This 
review was facilitated by an enlarged view of the retrieved 
ROI and the accompanying biopsy reports. On the basis of 
this interaction, the radiologist selected a BI-RADS score for 
the ROI. Again, the reader was not restricted by a time limit 
for establishing this diagnosis, and both magnification and in¬ 
version were provided as options on the user interface. 

To evaluate the diagnostic improvement provided by the 
mapped-database diagnostic system,Ve computed the ROC 
of each unaided radiologist, of each computer-aided radiolo¬ 
gist, and of the computer alone. Each ROC accounted for the 
BI-RADS responses of the radiologists and for the outcomes 
of the biopsies. The diagnostic performance of each radiolo¬ 
gist was measured by the area under the ROC curve, which 
is an estimate of the probability for a correct decision in a 
forced choice between two ROIs, one of which is malignant 
and the other of which is benign (27). Thus, A^ must lie be¬ 
tween a minimum of 0.5 (corresponding to an unbiased ran¬ 
dom guess) and a maximum of 1 (perfect performance). 

We also computed the average performance of the four ra¬ 
diologists when unaided by the mapped-database system and 
when aided by the mapped-database system. LABMRMC 
(C.E. Metz, LABMRMC l.OB, beta version 3, University of 


401 























SKLANSKYETAL 


Academic Radiology, Vol 7, No 6, June 2000 



False-Positive Fraction 

Figure 4. ROC curves for radiologist and for the computer 
alone. 


Chicago, Chicago, Ill) (28) was employed to calculate the 
maximum likelihood estimates for the parameters of binor¬ 
mal models and the statistical significance of the change in 
areas under the ROC curves for the unaided and the aided 
reading modalities. The ROC curves representing the aver¬ 
age performance of the unaided radiologists were computed 
by averaging their estimated slopes and intercepts in normal 
deviate space. This same process was also performed for the 
aided radiologists. 

The mapped-database diagnostic system was designed 
and implemented at the University of California, Irvine, on 
an IBM-PC-compatible computer with a 66-MHz Intel 486 
processor, 32 MB of random access memory, and a 17-inch 
CTX monitor with 1,280 x 1,024 pixels running on a Micro¬ 
soft (Redmond, Wash) Windows 95 operating system. The 
software development environment was Microsoft Visual 
C++ 4.0 for image-processing functions and Microsoft Vi¬ 
sual Basic 5.0 for the user interface. Testing of this system 
was performed at KDMC on another IBM-PC-compatible 
computer with a 233-MHz Pentium II processor, 64 MB of 
random access memory, and a 17-inch monitor (Vivitron; 
Gateway 2000, Sioux City, SD) with 1,280 x 1,024 pixels 
running on a Microsoft Windows 95 operating system. 


RESULTS 


The ROC curves, labeled by their values, are shown 
in Figures 4-8. The statistical significance of the changes 



Figure 5. ROC curves for radiologist and for the computer 
alone. 



False-Positive Fraction 


Figure 6. ROC curves for radiologist Rg and for the computer 
alone. 

in these values is reported in Table 2. The columns of 
jv.alues fw the unaided radiologist, the aided radiologist, 
and the computer alone are labeled A, B, and C, respec¬ 
tively. The column labeled A-B denotes the values of P as¬ 
sociated with the increase in A^ obtained .by replacing an 
unaided radiologist with the corresponding aided radiolo¬ 
gist. The values of P listed in Table 2 are two-tailed and 
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Figure 7. ROC curves for radiologist and for the computer 
alone. 


Table 2 

Comparison of ROC Curves for the Unaided Radiologist, the 
Aided Radiologist, and the Computer Alone 


Reader 


4 


P 

A, Unaided 

B, Aided 

C, Computer 
Alone 

A-B,Two- 
tailed 

R, 

0.7150 

0.8354 

0.7533 

0,0157 

R. 

0.7179 

0.8814 

0.7533 

0.0013 

R3 

0.6277 

0.7538 

0.7533 

0.0015 

R4 

0.7157 

0.8077 

0.7533 

0.0636 


were calculated under the assumption that the distribution of 
each estimated change in divided by the estimated stan¬ 
dard error of that change, arose from a normal distribution. 
These values of P were computed by using the ROCKIT 
software (C. E. Metz, ROCKFIT 0.9B, beta version, Univer¬ 
sity of Chicago, Chicago, Ill, 1998). 

The information in Figures 4-7 indicates that (a) every 
aided radiologist outperformed the same unaided radiologist, 
(b) no unaided radiologist outperformed the computer alone, 
and (c) three aided radiologists outperformed the computer 
alone and the fourth aided radiologist (R^) performed ap¬ 
proximately equal to the computer alone. The information 
in Table 2 indicates that the values of the unaided radi¬ 
ologists ranged from 0.6277 to 0.7179, and that those of 
the aided radiologists ranged from 0.7538 to 0.8814. The 
size of the changes in among the radiologists ranged from 



0 I" ' I . t . . t . i I 
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Figure 8. ROC curves for the average performance of the four 
radiologists. 


0.0920 to 0.1635. Table 2 also indicates that the A-B changes 
in A^ (ie, unaided-to-aided changes in A^ were statistically 
significant at P < .002 for radiologists ^ and R 3 , at P < .02 
for radiologist R^, and at P < .07 for radiologist R^. After ap¬ 
plication of the Bonferroni correction for multiple compari¬ 
sons, these three P bounds became .008, .08, and .28, respec¬ 
tively (29). Other changes in A^—^namely, A-C (ie, unaided- 
to-computer alone changes) and B-C (ie, aided-to-computer 
alone changes)—were not statistically significant. 

Figure 8 shows the average performance of the four radi¬ 
ologists when unaided by the mapped-database system and 
when aided by the mapped-database system. Results of the 
LABMRMC analysis indicate that performance of the aided 
radiologists, as a group, was statistically superior toThat of 
the unaided radiologists as a group (P < .05), 

At KDMC, the diagnostic scores S and M are convention¬ 
ally interpreted as being biopsy recommended, and N, B, and 
P are interpreted as being biopsy not recommended. In ac¬ 
cordance with this convention, we calculated the numbers of 
negative biopsies and misdiagnosed cancers, as well as the 
sensitivities and specificities of each radiologist, both aided 
and unaided by the mapped-database system. These results 
are shown in Tables 3-5. Tables 3 and 4 show the numbers 
of recommended benign biopsies and misdiagnosed cancers. 
Table 5 shows the sensitivities and specificities. The mapped- 
database diagnostic system helped every radiologist reduce 
the number of benign biopsies by 40% or more while simul¬ 
taneously reducing the number of misdiagnosed cancers. All 
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table 3 

Numbers of Recommended Benign Biopsies for the Unaided 
Radiologist and the Aided Radiologist 


Reader 

Unaided Radiologist 

Aided Radiologist 

R, 

18 

11 

Ra 

i5 

8 

R 3 

28 

18 

R. 

18 

10 

NN 

24 



Note.—Number of ROls from benign cases: 57. NN = neural 
network. 


the radiologists also increased both their sensitivities and 
specificities through their interaction with the mapped-data- 
base system. The statistical significances of these increases 
ranged from P < .01 to ? < .12 on the basis of a comparison 
of proportions (30). 

As mentioned, the sensitivities, specificities, and ROCs 
were calculated on the basis of the 160 abnormal ROIs and 
the responses of the panel of radiologists to them. The re¬ 
sponses of the panel of radiologists to the 20 normal ROIs 
(the remaining 20 normal ROIs were in the set Dj^) were 
excluded from these calculations, because in this study, the 
mapped-database diagnostic system was designed only to 
interpret abnormal ROIs. 


DISCUSSION 


Figures 4-8 and Tables 2-5 indicate that the diagnostic 
performances of the aided radiologists were statistically 
significantly improved compared with those of the unaided 
radiologists. Table 2 shows that the sizes of these improve¬ 
ments in for the current study are comparable to those in 
found during a recent study concerning computer-aided 
characterization of mammographic masses ( 20 ). 

We are also encouraged by the improved performance of 
the aided radiologists over that of the computer alone, as in¬ 
dicated in Figures 4,5,7, and 8 and in Table 2, although the 
number of cases was insufficient to prove statistical signifi¬ 
cance of these improvements. Table 5 shows.that the mapped- 
database diagnostic system enabled substantial increases in 
specificities and sensitivities for all the radiologists in our 
panel. We conclude that for ROIs containing microcalcifica- 
tion^. the mapped-database diagnostic system shows promise 
in helping most radiologists to raise their diagnostic perfor¬ 
mances substantially over their unaided performances while 
providing relevant images from a proved database to support 
the radiologists’ aided diagnoses. In particular, these radiolo- 


Academic Radiology, Voi 7, No 6, June 2000 


Table 4 

Numbers of Misdiagnosed Cancers for the Unaided 
Radiologist and the Aided Radiologist 


Reader 

Unaided Radiologist 

Aided Radiologist 

R, 

11 

8 

R 3 

12 

7 

R 3 

7 

4 

R. 

8 

3 

NN 

4 



Note.—Number of ROIs from malignant cases: 23. NN = neural 
network. 


gists may achieve substantial reductions in the number of 
benign biopsies and misdiagnosed cancers. 

The levels of postresidency mammographic experience 
among the radiologists in this study ranged from 29 years 
to 6 months (R^ > R^ > R 3 > R^). Figures 4-7 suggest that 
all radiologists are likely to benefit substantially from ac¬ 
cess to the mapped-database diagnostic system regardless 
of their experience. This is important, because radiologists 
vary widely in their diagnostic skills—even among those 
who rate themselves as “experts” (31). Whether the size of 
the benefit correlates with the amount of experience, how¬ 
ever, is not clear from Figures 4-7. (It is interesting that the 
performance of the aided R^ exceeded that of the aided R^, 
even though the experience of R^ was greater.) 

The results of this study suggest that a properly designed 
interface between a human reader and a proved database of 
mammographic images may enable less experienced readers 
to exceed the performances of unaided, highly skilled read¬ 
ers—without the need for time-consuming training on fea¬ 
ture extraction as exemplified by Getty et al (19). Further¬ 
more, our diagnostic system represents an improvement over 
earlier systems (17,19) by automating the selection of visual 
features. 

This study was limited, however, by the quality of the 
monitors used for viewing the images, the size and compre¬ 
hensiveness of the mammographic database, the lack of 
full-field and earlier views, the restriction of the lesions to 
microcalcifications, and a possible “reading-order effect” 
associated with the close succession of unaided and aided 
diagnoses (32). Our next investigation of the mapped-data¬ 
base diagnostic system will include several enhancements 
to overcome these limitations. The images will be viewed 
on state-of-the-art, high-resolution radiographic monitors, 
and the number of cases will be increased. The tested im¬ 
ages will also include full-field craniocaudal and mediolat- 
eral oblique or lateral views of each breast, and the lesions 
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COMPUTER-AIDED DIAGNOSIS OF MAMMOGRAPHIC REGIONS 

Tables 

Statistical Significance of Changes in Performance 




Unaided Radiologist (%) Aided Radlologik (%) 

Change in Sensitivity 

Change in Specificity 

Reader Sensitivity Specificity Sensitivity 

Specificity 

Change (%) P 

Change (%) P 


47.8 

73.7 

69.6 

86.0 

+21,8 

<01 

+12.3 

.12 

65.2 

68.4 

87.0 

82.5 

+21.8 

<.01 

+14.1 

<,05 

52.2 

68.4 

65.2 

80.7 

+13.0 

.09 

+12.3 

.07 

69.6 

50.9 

82.6 

68.4 

+13.0 

<.05 

+17.5 

<,05 




I 


? 


will include both masses and microcalcifications. In addi¬ 
tion, the aided and unaided diagnoses will be separated by 
at least 1 month. 
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Example of a relational map. In this map 
each malignant ROI is labeled and each 
benign ROI is labeled o. The query ROI 
is labeled H. 
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Form for mammographic assessment and findings; list of pathology codes. 


MAMMOGRAPHY ASSESSMENT AND FINDINGS 


Patient Study identification Number 


Screening Assessment 
Final Assessment 
Breast Composition 
Clinical Correlation 


Oa 

1 

1 


Ou 

2 

2 


Oo 

3 

3 


Age 

1 

48 . 

4 


2 

4b 


3 

4c 


Date 

4 

5 


Date 

Date 


Finding correlates to ciincial exam finding in QL OR QB breast(s)at; 


. o’clock 


Assessment Categories 
Oa = Additional films 
Ou = Ultrasound 
Oo = Outside Films 

1 = Negative 

2 = Benign finding 

3 = Probably benign 

4 = Suspicious abnormality (a-mild, b-moderate, c-high) 

5 = Highly suggestive of malignancy 


Breast Composition 

1 = Almost entirely fat 

2 = Scattered fibroglandular densities 

3 = Heterogeneously dense 

4 = Extremely dense 


Mammography Findings 

R 1 



MASS 






Size /Number 

in area 
of density? 

Shape 

Margins 

Density 

_cm _ » 

□ Yes 

□ No 

□ Round □ Lobular 

□ Oval □ Irregular 

□ Circumscribed □ lll>defined 

□ Microlobulated □ Splculated 

□ Obscured 

II 

o a 

□ Equal 

□ Fat containing 

_cm _ # 

□ Yes 

□ No 

□ Round □ Lobular 

□ Oval □ Irregular 

□ Circumscribed □ ill-defined 

□ Microlobulated □ Splculated 

□ Obscured 

□ High 

□ Low 

□ Equal 

□ Fat containing 


CALCIRCATIQNS 


Distribution Modifiers 

□ Grouped/Clustered 

□ Linear 

□ Segmental 

□ Regional 

□ Diffuse/Scattered 


Typically Benign 

□ Skin □ Eggshell/Rim 

□ Vascular □ Milk of Calcium 

□ Coarse □ Suture 

□ Large rod-like □ Dystrophic 

□ Round □ Punctate 

□ Lucent-centered 


Intermediate Concern 

□ Amorphous or Indistinct 

Higher Probability of 
Malignancy 

□ Pleomorphic/hetereogenous 

□ Fine, linear branching 


Other Findings 

□ Skin thickening 

□ Trabecular thickening 

□ Skin lesion 


□ Skin retraction 

□ Nipple retraction 

□ Axillary adenopathy 


□ Asymmetric breast tissue 

□ Focal asymmetric density 

□ Architectural distortion 


Pathology Diagnosis: Benign 


Malignant __ 


Comments: 



MAMMOGRAPHY PATHOLOGY CODES 



MALIGNANT 


BENIGN 

ANC 

metastatic disease Axillary Node 

AB 

ABscess 

cc 

Colloid (mucinous) Carcinoma 

AD 

ADenosis 

Cl 

Comedocarcenoma (Intraductal) 

ANL 

Axillary Node with Lymphoma 

CP 

intraCystic Papilloma 

BC 

Benign Cyst 

DS 

Ductal carcinoma in Situ 

DE 

Duct Ectasia 

IC 

Intracystic papillary Carcinoma 

DH 

Ductal Hyperplasia 

ID 

Invasive Ductal carcinoma 

EC 

Epidermal inclusion Cyst 

n 

Invasive and In situ cancer 

FA 

FibroAdenoma 

IL 

Invasive Lobular carcinoma 

FB 

Foreign Body 

IN 

INflammatory carcinoma 

FC 

FibroCystic change 

IP 

Papillary Invasive carcinoma 

FF 

Focal Fibrosis 

LN 

Lymph Node 

FN 

Fat Necrosis 

LY 

Lymphoma 

GA 

GAlactocele 

MB 

Metastatic lesion to the Breast 

GF 

Giant Fibroadenoma 

MC 

Medullary Carcinoma 

GYN 

GYNecomastia 

MI 

Multifocal Intraductal carcinoma 

HB 

Hamartoma of the Breast 

PC 

Papillary Carcinoma in situ 

HE 

Hematoma 

PD 

Paget’s Disease 

IM 

IntraMammary node 

RM 

Recurrent Malignancy 

LB 

Lipoma of the Breast 

S 

Sarcoma 

LH 

Lobular Hyperplasia 

TC 

Tubular Carcinoma 

LN 

Lymph Node 



LP 

Large duct Papilloma 



NA 

No Abnormality 


HIGH RISK LESIONS 

PT 

Phylloides Tumor 

ATD 

ATypical Ductal hyperplasia 

RS 

Radial Scar 

ATL 

ATypical Lobular hyperplasia 

SA 

Sclerosing Adenosis 

LS 

Lobular carcinoma in Situ 

SE 

SEroma 

PP 

Peripheral duct Papilloma 

SG 

Silicone Granuloma 



ST 

Scar Tissue 
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■ 
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_ 




Televhone Number: 
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E-Mail Address: 
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. ___ PL Faculty Sponsor’s Assurance _ . . 

By my signature as sponsor on the research application, I certify that the student is knowledgeable about the regulations 
and policies governing research with human sul^'ects and has sufiBcient raining and experience to conduct this particular 
stucfy in accord with the approved protocol. In addition, 

1. I agree to meet with the^nvestigator on a regular basis to monitor study progress. 

2. Should problems arise in the course of the study, I agree to be available to personally supervise the investigator in , 
solving them. 

3. I assure that the investigator wiU promptly report AEs to the IRB according to the schedule indicated al»ve. 

4. If I will be unavailable, as on vacation, I will arrange an alternate faculty sponsor to assume responsibility during my 
absence and I will advise the IRB of such arrangements. 


_ Faculty Sponsor (if PI is a student, resident, or fellow) _ 

□ 


IV. finding 

□ Federal □ Pharmaceutical Company □ Private Foundation □ Internal grant program, U Industry, 

Other. Snecify: 

Funding Source: 

California Telehealth & Telemedicine Center 

Contract or Grant Title*; 

Database-Airted Telemammography 

Contract or Grant #: 

221 

♦Please indicate whether the stu<fy under review is being conducted imder the auspices of a 
larger umbrella grant (e.g., RCM Clinical Research Center, Program Project Grant) 

□ Yes ElNo 


V. Statement tlnaadal Interests 


By their signatures below, each investigator is certifying that either no financial interest exists or that a complete listing 
of all financial interests related to the proposed project is provided. All individuals named below further acknowledge 
their responsibility to disclose any new reportable financial interest obtained during the term of the project. The Pnncipal 
Investigator’s signature also certifies that all individuals required to make disclosures have been listed below: 


Do you, youf-spouse, or dependent children, have a financial interest in the work to be conducted under the proposed project? 

riNQ ^YES, Attach Financial Disclosure Form 

JigrwJ^ire of Prkicipal Investigator Date 

2 ^ ^ NO QyES, Attach Financial Disclosure Form 

^iJature of Co-Investigator #1 Date 



3. 


QnO Dyes, Attach Financial Disclosure Form 


Signature of Co- favestigator #2 


Date 


1 YL ApDlication Status: 

6. Please check the appropriate description of the study: 

S New Application 4® to Section VII) □Re-review of stu^ previously aRiroved by 

□Re-ieview of stu<fy previously approved 1 
□Re-review of stufy previously judged to 1 

full IRB 

jy expedited review, 

X exempt 

7. Date of Original Review 


8. Efatefs) of continuation reviews 


9. Total number of subjects antieij^'^ted to be enrolled 

1200 

lO.Total number of subjects enrolled to date 

0 

11. Age range of subjects 

18 and over 

12. Is this study oermanently closed to new subject enrollment? 

□ Yes I^No - 

13. Have you completed the data analysis? 

Note: As long as data analysis is being conducted, this study will remain open with the IRB 

□ Yes ^No 
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14. Have there been any unexpected reactions or complications during the conduct of this stu^? 
If so, please attach adverse event reports. _____ 
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Q Yes EINo 




vn. Summary Information 


1 Jffas-aData Safety Monitoring Board been established to review data/adverse events 
related to this study? ___—- 

□ Yes I3 No 

1 Siihiert Ponulation tnleasc check all appropriate boxes)--—, 


□ 

a. Abort uses/fetuses 

□ 

e. Drew House 
Officers/Residents ^ 

□ 

i. Normal volunteers 

u 

m. Students 

■■ll 

b. Cancer subiects 

"n 


m 

i. Patients 

IB 

EBnSiSiEIQSliHHI 

■■11 

c Comatose 

m 


□ 

k. Prisoners or parolees 

M 


□ 

d Decisionallv imoaired 

□ 

h. Minors 

□ 

1. Pregnant women 



^Ap 

proval of Graduate Medical Office is necessary prior to IRB approval 

' 11 

f the research involves suiy of the following. Check the appropriate boxes - 

□ 

a. AudioMdeotapes 

□ 

m. mV screening 

n 

b Acute care waiver of informed consent 

□ 

n. Investigational drugs 


c. Alcohol and dug abuse research 

m 

0 . Investigational devices 


d Behavioral observations 

111 



e. Biohazardous waste 

m 




□ 

r. National Cancer Institute Trial (NCI)"’ 

□ 

__ s. ___—-- ■ - 

g. Collection of surgical specimens 

c 

r. NIH Cooperative Groups (i,e., RCMI) 

□ 

h Controlled substances 

c 

s PI or CO-PI is the treating clinician 

n 

L Deception , 

11 

t. Radiation 

□ 

i. Gene therapy 

c 

iL Surveys, questionnaires, psychological testing 

□ 

k. Genetic research 

c 

v. Transplantation 

□ 

1 HIV/AIDS 

c: 

w. Vaccine trials 

*// 

xiifn 

Ote research is part of an NIH multi center clinical trial, the NIH sample informed consent form must be included with the 

W Av NCI all amroved chanzes must be forwarded to the Cooperative Group Headquart^, - 

1 A Tf fiiia i^cpurrh in he cunducted at anv other site than the CRDUMS or the KDMC, check ail that appl;g;-1 

n 

a. Haibor General Hospital 

□ 

f. USC/LA County Medical Center 

□ 

b UCLA Medical Center 

□ 

e Cedars/Sinai Medical Center 

TT 

c. Sl Francis Medical Center 

□ 

h. Daniel Freeman Medical Center 

1?^ 

d. Other hospital or medical center, specify: Hubert H. Humphrey Comprehensive Health Center (ffifflCHQ- 

n 

e. Other facilities, specify: -———- 

Not 

inst 

SltlU 

e- If any offsitefacilities are indicated, IRB approval and a letter ofsupport for this protocol are required from that 
itution. If the site does not have an IRB, it may be necessary to obtain a Single Project Assurance from OPRR to conduct the 
hf nt thnt tsifp PlpfiMp check with the IRB office. - — - - - - 

5. If there are any investigational drugs or biologic agents used in this study, please complete i 
Investigational Drug Information From with this application. - 

and include the 

6. Will vou be using the Clinical Research Facilities? 

□ Yes lElNo 

7. Docs your protocol require review by the Radioactive Drug Research Committee? 

If yes, please indicate the date of approval or if approval is pending: 

□ Yes ElNo 

8. Does your protocol require review by the Biohazards and Safety Committee? 

If yes, please indicate the date of approval or if approval is pending: 

□ Yes l^No 

9. Is this research being conducted to meet requirements for a course or to complete an 
academic degree? --——- 

□ Yes KINo 
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VHL Protocol Summary 


Please fill out the information requested in the following categories. If the item does not apply to your research, 
simply indicate that the question is not applicable. The information should be intelligible to IRB reviewers from ( 
variety of lay and scientific backgrounds. 

a 

1. Purpose of the study: What are the specific scientific aims of this study? 


A digital telemamiuography system linking the Hubert EL Humphrey Comprehensive Health Center 
(HHHCHC) to the "mapped database diagnostic system at the King/Drew Medical Center (KDMQ will be 
Uesigned, installed, operated, and evaluated. We wish to demonstrate that the proposed database-aided 
telemammography system will enable a significant reduction in recalls and biopsies without reducing the 
number of missed cancers. Statistics on the use of this system will be acquired over the period of this project to 

assist in evaluating its impact on the quality of mammographic services at HHHCHC. _ 

2. Background: State the background of the study, including a critical evaluation of existing knowledge and 
the information gaps that this research proposes to fill. Describe previous woric that provides a basis for the 
proposed research and that supports the expectations of obtaining useful information without undue risk to 

human subjects. Please include relevant citations. __ 

Professor Jack Sklansky, in the Department of Radiology at C.R. Drew University, recently supervised the 
development of a major new concept for computer-aided diagnosis: mapped-database reasoning. A pilot 
mapped-database diagnostic system was tested successfully at Drew for the diagnosis of apparent calcifications 
in digitzed mammmograms. This system currently uses a database of over 1000 full-field digital mammograms, 
along with marked regions of interest (ROIs). The database was acquired from the University of South Florida. 
A neural network maps this database onto a two-dimensional diaplay. The network does this by mapping each 
ROI into a dot on a screen, and arranges the dots so that they cluster into visually and medically similar 
groups. By annexing this neural network to a means of quickly retrieving and viewing ROIs that are mapped 
close to quety ROI, the radiologist is given a simple way of conversing with the database to enhance the 
reliablility of the radiologist's diagnostic decisions. Preliminary tests suggest that the mapped-database 
diagnosis can reduce the number of biopsies by about 40% without increasing the number of missed breast 
cancers. Such reductions could bring signiflcant financial and operational efHciencies to the detection and 
diagnosis of breast cancer. 


3. Study Design: Describe the study design (e.g., double blind, crossover, etc.) and sequentially list all 
procedures, drugs or devices to be used on human subjects. Describe any use of placebos and indicate 
whether subjects will be randomized in this study. IT there are any investigational drugs or biologic agents 
used in this study, please complete and include Attachment #1 with this application. 

The project will extend over a one-year period. During the first two months, the scaiming and computing hardware 
and the communication software will be installed and tested. Radiologists participating in this stud^ will be trained in 
the use of the mapped-database system as a diagnostic aid. During the remaining ten months of this project, data will 
be accumulated on the speed and diagnostic accuracy of both the standard procedure for mammographic diagnosis 
and the remote-access database-aided mammographic diagnosis. On two days of each week, all of the mammography 
patients arriving at HHHCHC will be invited to enroll in this stucfy. Those that do not accept this invitation will be 
examined by the standard diagnostic procedure currently carried out at HHHCHC ("standard procedure," for short). 
Each subject that accepts the invitation will first be examined by the standard procedure. The resulting diagnn.ci.«! ty 
the radiologist (which we refer to as the "standard diagnosis") and other pertinent data for this subject will be entered 
into the shufy's subject database. At that point the computer will tandoinly decide whether or not for this sutgect the 
standard diagnosis will be followed ty a database-aided diagnosis. If the subject is selected for a database-aided 
diagnosis, the radiologist will interact with the computer to form a database-aided diagnosis for this subject. This 
diagnosis will be added to the computer's file for this subject. In all cases the standard diagnosis will determine the 
management of the subject. However, as a result of the radiologist's interaction with the computer and its database of 
similar cases, the radiologist may decide to recall the subject ic discuss options and advisability for further tests and 
procedures. 
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Studv Ponufation 


4. Study Population: Describe the characteristics of the subject population such as the anticipated number, 
age range, gender, ethnic background and health status. Provide a candid discussion of potential problems 
related to the s^idy population. Explain the rationale for the use of special classes such as fetuses, pregnant 
women, children, prisoners, or other vulnerable populations. If women, minorities or children are excluded, 
provide written justification. 


The sutyect population will be restricted to all women at least 18 years old requesting mammography at HHHCHC. 
The expected number of subjects entering this studjy is about 1200. The ethnic background will reflect the population 
served by HHHCHC: primarily African-American and Latino. 


5. Indicate the criteria for exclusion and inclusion and explain the system for equitable selection of subjects. 
Any woman at least 18 years old who is accepted for standard mammography at HHHCHC will be eligible for this 
stucfy. 


6. How is eligibility determined and by whom? 


Research associates will accept to this study all female subjects at least 18 years old and receiving standard 
mammographic care at HHHCHC. 


7. Recruitment: What methods will be used to identify and recruit potential subjects. Attach a copy of all 
planned advertisements, flyers and letters, etc. to potential subjects. 


Subjects for this study will be recruited from those arriving for mammography in the radiology 
waiting room at HHHCHC. On two days of each week, a research associate trained for this project 
will wait for mammographic patients arriving in the radiology waiting room. The research 
associates for this study will be Ricardo Vega, M.D. and La Tasha Peterson. Dr. Vega will be 
responsible for interviewing and recruiting the subjects for this study. La Tasha Peterson will assist 
him. Dr. Vega or Ms. Peterson will carry out each recruitment interview. The receptionist in the 
radiology waiting room will ask the potential subject whether she would be interested in learning 
about an ongoing clinical research project. If the potential subject says Yes, the receptionist will 
intrduce the potential subject to either Dr. Vega or Ms. Peterson. 


_ Research Methods and Procedures __ 

8. Methodology and Data Collection: Describe the research procedures that will be followed. Please indicate 
those that are experimental and those that may be considered to be standard treatment Describe all 
activities involving human subjects and explain the frequency and duration of each activity. 
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Using the subjects' film mammograms and medical histories we will compare two modes of mammographic diagnosis 
fiom the points of view of health benefits and speed. These modes are listed below. 

Mode A: reading of film-screen mammograms at HHHCHC, with no computer-aided diagnosis. We refer to this as 
"standard" mammographic diagnosis. This diagnosis will determine the management of the subject for Mode A. 

Mode C: reading of film-mammograms at HHHCHC, with the use of the remotely sited computer as an aid to 
diagnosis. We refer to this as "database-aided" mammographic diagnosis. 

Mode C will consist of two parts in succession: Cl followed C2. In Cl the radiologist will read the films as in 
Mode A, with no computer-aided diagnosis. This diagnosis will determine the management of the subject for Mode 
C. In C2 the radiologist will interact with the database-aided diagnostic system to formulate a possibly revised 
diagnosis As a result of tliis interaction, the radiologist may decide to recall the subject to discuss options and 
adrisability for further tests or procedures. 

The aiccignment of each Subject to either Mode A or Mode C will be carried out ly a computer-generated random 
process immediately after completion of the standard mammographic diagnosis for that subject. 

In A, Cl, and C2, the responsible radiologist will score each subject by the Bl-RADS code (l=normal, 2-benign, 
3=probably benign, 4=suspicous, 5=probably malignant). For each subject the recorded data will include a) the date 
and time of arrival of each mammography subject, b) the responsible radiologist, and c) the date and time when the 
treatment, if any, of that subject is (tetermined. 

At the end of the acquisition of data for this stu(fy, the speed and diagnostic effectivness of the mammographic 
services provided by Modes A and C will be evaluated. This evaluation will be based on analysis of the recorded data 
in Modes A and C and on interviews with the radiologists at HHHCHC that are involved with this stu(fy. 


9* If your study uses surveys, questionnaires, or psychological tests, please describe the provisions for 
administering these measures, the mode of administration, the setting and if special training or 
qualifications are necessary* 

10. Please comnlete the following questions r^arding data storage: 

a. How will the data be collected 
and recorded? How will the data 
be coded to protect personal 
privacy? 

Mammographic data will be sent to BCDMC and back to 
HHHCHC. Before transmittal to KDMC, each subject's 
name will be deleted. A numeric tag will identify the data but 
not the person. The resulting tagged images will not be 
identifiable to anyone outside of the Department of Radiology 
at HHHCHC. 

b. How will the data be stored 
during the study? 

The depersonalized data will be stored in our computer's 
memory at KDMC. All personal identifiers will be deleted 
fi-om this data. In addition, the personalized data wiU stored in 
a locked file cabinet at HHHCHC. The personalized data will 
accessible only to the subject's radiologist or to another 
medical professional approved by the subject. 
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c. Who will have access to the 
data and the data codes? If data 
with subject identifiers will be 
released, specify the person(s) 
and agencies to whom this 
information will be released 


d. What will happen to the data 
when the stu<fy is completed? 
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The principal investigator, the computer engineer, and 
radiologists from KDMC and HHHCHC will have access to i 
the depersonalized data. The personalized data will be 
accessible only to the subjects; radiologists at HHHCHC or to 
another medical professional approved by the subject_ 


The data at BCDMC with personal identifiers deleted wll ^ 
remain intact, and will be available for use in future research. 
The personalized data will be under control of the subject and 
the subject's radiologist. 


Risk/Benefit Assessment ..__ 


11. Potential Risks and Discomforts: Describe any potential risks or likely adverse effects of the drugs, 
biologies, devices or procedures subjects may encounter in the study. State the potential risks - physical, 
psychological, social, l^al or other — connected with the proposed procedures and assess their likelihood and 


seriousness. 


There are no serious risks in taking part in this research. The subject may be called back by the radiologist 
for additional worlcups or biopsies as a result of enhancement of the radiologist's diagnostic ability provided by 
the d^itized database. 


12. Risk Classification: Please check the level* of risk associated with this study 

* According to HHS/FDA regulations minimal risk means, “The probability and magnitude of harm or discomfort anticipated in 
tile research are not greater in and of themselves than those ordinarily encountered in daily life or during the performance of 
routine physical or psycholo^cal examinations or tests. ” When the risks that are associated with a new procedure or product are 
unknown, they cannot be classified as minimal. 

^ minimal O greater than minimal □ unknown__ 


13. Safety Precautions for Minimizing Risks: Describe the procedures for minimizing any potential risks. 

Where appropriate, discuss provisions for ensuring necessary medical or professional intervention in the event 
of adverse effects to the subject Where appropriate describe the provisions for monitoring the data collected to 
ensure the safety of the subiects. ___ 


The radiological risks are the same as in ordinary screening or diagnostic mammography. 


14. Benefit Ratio: What is the risk benefit ratio of this research, compared with available alternatives? 

Describe the potential benefits the subjects may receive as a result of their participation in the research and 
what benefits to society may be expected. The potential ben^ts of the research must justify the risks to human subjects. The 
risk ben^t ratio of the research must be at least as favorablefor the subjects as that presented by standard treatments for their 
condition. When comparing the risk/ben^t ratio of research with that ofavailable alternatives, the alternative ofdoing nothing 
should be included in the analysis. 


im 
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15. Therapeutic Alternatives: What therapeutic altemative(s) are reasonably available to potential subjects . 
should they choose not to participate in the study? These may be research or non-research-based alternatives. 

There are no therapeutic alternatives to this project. If the subject does not wish to participate in this study, 
she will receive a standard mammographic examination that does not involve computer-aided diagnosis. 

Financial Considerations 

16. Payment for Participation: Describe all plans to compensate subjects, including provision of services, and 
other reimbursements. Describe the conditions that subjects must fulfill to receive fun oF^rtial payment. 

Each subject will be paid ten dollars for participating in this project. Subjects will not receive any 
financial compensation for any commercial product created as a result of this project. 

17, Financial Obligations of Subjects: Will subjects have to pay for any of the tests or treatments that they 
receive as part of the research? Please clarify who will pay for the procedures associated with the stuefy as well as 
procedures that may be part of standard clinical care. Clarify that insurance and other third party payors may not 
cover standard procedures if they are associated with a research project 

Subjects will not incur any financial obligations as a result of participation in the study other than the 
fees HHHCHC usually charges for a mammogram. 

18* Emergency Care and Compensation for Research-Related Injui^: If the research presents a greater than 
minimal risk, the financial liability for the costs of care associated with potential research related illness/injury 
must be specified, (if no funds are available, please see the consent form template for the standard language to 
explain this to potential subjects) 

This stuefy does not present greater than minimal risk. Subjects will not be compensated for out-of-pocket expenses 
or lost wages if they suffer a research related injury. 

Informed Consent 

19. Capacity to Consent: Will all subjects have the capacity to give infonned consent? If not, describe the likely 
range of impairment and explain how, and by whom, their capacity to consent will be determined. 

Adult subjects will have the capacity to give informed consent. 

20, Study Personnel Administering the Consent Process: Please identify by name and training the individuals) 
who will be authorized to describe the research to subjects, or their representatives, and to invite their 
participation. To insure that subjects give complete informed consent and are able to ask and have answered all 
questions regarding the nature of their participation, the personnel administering the consent must have appropriate 
training and background. - 

Ricardo Vega, M.D., assisted La Tasha Peterson, will be authorized to read and explain the contents of the Human 
Subject Consent Form to each subject. Dr. Vega is a member of Drew*s RCMI, and has extensive experience in 
interacting with human subjects in clinical research. La Tasha Peterson is the Program Administrator of Dr. 

Sklansky’s research project on database-aided mammographic diagnosis. Dr, Vega and Ms. Peterson wiU be trained 
for this project in Dr. Sklansky's laboratory at KDMC. Both Dr. Vega and Ms. Peterson successfully completed a 
course on Protection of Human Subjects. 

/ 
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21. Process of Consent: Please discuss how the consent process will be conducted, describing the foUowing 
elements: a) the environment and location vhere the informed consent will be solicited; b) opportunities for the 
potential subjects to discuss their participation with family or others before signing the consent form; c) how 
and by whom it will be determined whether the subject or their legally authorized representatives underst^d 
the information provided; and d) the types of forms used (e.g., adult consent form, assent form for youth, 

translations to other languages, etc.) __^_ - _ 

The subjects will have as much time as thg^ wish to study the consent form alone or with family members, and to ask 
questions of the radiology staff before signing the foiiarTfie radiologists and radiological staff will be trained to 
avoid any semblance of psychological pressure on the subject while presenting and explaining the consent form. 


22. Information Withheld from Subjects: Will any information about the research purpose and design be 
withheld from subjects? Jf so, please explain the non-disclosure and describe plans for post-study de-brief»ng- 
None of this information will be withheld. 


23. Please delineate the data analysis plans for this study. Include planned statistical analyses and explanation 
of determination sample size. 

For details on data analysis, see section 8 on "Methodology and Data Collection." 
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ABSTRACT 


DATABASE-AIDED DIGITAL MAMMOGRAPHY 


by 

J. Sklansky, EngScD and C. J. Ornes, MS 
infoRAD Exhibit 


presented at the 2000 Annual Meeting 
of the Radiological Society of North America 
November 26-December 1, 2000 
Chicago, Blinois 


We demonstrated a new system for the database-aided diagnosis of mammograms. This system 
includes two computers, a scanner, two high-resolution monitors, and two standard computer 
monitors. In this system a recently devised "visual neural network" maps each region of interest 
(ROI) in a database of proven mammographic ROIs as a dot on one of the monitors. We refer to 
this array of dots as a relational map. Clusters of dots on the relational map represent visually 
similar ROIs. For each new case to be analyzed, a dot representing the query ROI is 
superimposed on the relational map. The radiologist is then given an opportunity to use the 
relational map to search for similar ROIs from a database of proven ROIs. In addition to creating 
the relational map the neural network responds to a query ROI by recommending either to biopsy 
or not to biopsy. Preliminary results suggest that providing a radiologist with a neural network 
"second opinion" and allowing the radiologist to browse a database of ROIs may lead to a 
reduction in the number of benign biopsies without an increase in the number of missed cancers. 


CERTIFICATE OF MERIT 

The Radiological Society of North America awarded each of the authors a Certificate of Merit 
“in recognition of the excellence of your infoRAD exhibit .” 
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CURRICULUM VITAE 


(PM RedacteJ] 



Education: Eng.Sc.D., 1955, Columbia University 

M.S.E.E., 1952, Purdue University 

B.E.E., 1950, The City College of New York 


Honors and Awards: 

Fellow of the Institute of Electrical and Electronics Engineers 

Fellow of the International Association for Pattern Recognition 

Award for Research Excellence, School of Engineering, UCI 

Annual Award of the Pattern Recognition Society 

TauBetaPi 

Sigma Xi 

Eta Kappa Nu 

Who's WTio in America 

Professional Interests: 

Automatic pattern recognition, machine vision, medical imaging, computer-aided diagnosis, 
intelligent machines, trainable classifiers, learning theory, neural networks, computer 
engineering, biomedical engineering. 


Academic Appointments: 

Research Professor of Electrical and Computer Engineering and of Radiological 
Sciences, University of California, Irvine, 1994-present 

Professor of Radiology, Charles R. Drew University of Medicine and Science, 
1996-present 

Research Professor of Radiological Sciences, UCI, 1971-1994 
Professor of Electrical and Computer Engineering, UCI, 1969-1994 
Professor of Information and Computer Science, UCI, 1969-1989 
Chairman of Electrical Engineering: 1978-1979 
Associate Professor of Electrical Engineering, UCI, 1966-1969 










Consulting Activities since 1987: 


CR Technology, Laguna Niguel, California, 1997- present 

Member of Board of Directors of Vartec Corporation, Irvine, California, 1984-1992. 

Synthetic Aperture Real Time Imaging Corporation, 1991 

Carelink, 1990 

De La Rue Printrak, 1990 

Curt Decker Associates, 1990 

U. S. Army, 1988 

John Wiley and Sons, 1988 

Addison Wesley, 1988 

Aerojet-General 1988 


Honors and Awards: 

Fellow of the Institute of Electrical and Electronics Engineers, for contirbutions to 
digital pattern classification and medical applications.” 

Fellow of the International Association for Pattern Recognition, “for contibutions to 
pattern recognition, machine, and medical imaging, and service to flie lAPR.” 

Award for Research Excellence, School of Engineering, UCI 

Aimual Award of the Pattern Recognition Society 

TauBetaPi 

Sigma Xi 

Eta Kappa Nu 

Who's Who in America 


Professional Service and Activities: 

Member of Advisory Committee for 

MTAC 2000 - The Multimedia Conference for the Arts and Sciences 

Chair of Welfare Committee of UCI Emeritae/I Association 

Co-Chair of International Workshop on Digital Video for Intelligent Systems, 
December 1993. 

Member of Governing Board of the International Association of Pattern Recognition 
(lAPR) 
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Chainnan of the lAPR King-Sun Fu Award Committee 
Member of Editorial Board of Machine Vision and Applications 
Associate Editor of Pattern Recognition 

Co-editor of Special Issue of the Journal of the Optical Society of America A on 
"Pattern Recognition and Image Understanding" 

Member of Organizing Committee and Program Co-Chairman of the International 
Symposium on Computer-Aided Radiology, held in Anaheim, California in June 
1990. 

Member of Organizing Committee of the 1990 International Symposium on 
Computer-Assisted Radiology. 

Member of Program Committee of the Third Int. Conf on Computer Analysis of 
Images and Patterns, Leipzig, German Democratic Republic, September 1989 

Member of Program Committee of 1989 International Symposium on 
Computer-Assisted Radiology, June 1989 

Member of Adv. Board of IEEE Trans, on Pattern Analysis and Mach. Intelligence. 

Co-chairman of U.S. Army Conference on Pattern Recognition in Advanced Missile 
Systems, Huntsville, Alabama, November 1988. 

Co-chairman of Program Committee for SPIE Conference on Hybrid Image and 
Signal Processing, Orlando, Florida, April 1988. 


Session chair at the following conferences since 1987: 

Pattern Recognition in Practice, June 1997 

International Conference on Pattern Recognition, August 1996 

International Conference 3333on Computer Analysis of Images and Patterns, Sept. 
1993. 

International Conference on Pattern Recognition, September 1992 
International Conference on Pattern Recognition, June 1990 
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International Symposium on Computer-Assisted Radiology, June 1989 
International Conf.on Computer Analysis of Images and Patterns, September 1989 
International Conference on Pattern Recognition, November 1988 
Conference on Pattern Recognition in Advanced Missile Systems, November 1988 
SPIE Conference on Hybrid Image and Signal Processing, April 1988 


Reviewer for the following journals: 

IEEE Transactions on Pattern Analysis and Machine Intelligence 
Machine Vision and Applications 
IEEE Transactions on Medical Imaging 
Pattern Recognition 

Computer Vision, Graphics and Image Processing 
Intemational Journal of Pattern Recognition and Artificial Intelligence 
IEEE Transactions on Systems Man and Cybernetics 
Journal of the Optical Society of America A 


Reviewer for the foUowing funding agencies: 

National Science Foundation 
National Institutes of Health 
U.S. Army Research Office 
University of California MICRO program 
National Research Council of Canada 


Reviewer of books for the following publishers: 
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lOP Publishing Ltd., Philadelphia 
Springer-Verlag, New York 
John Wiley, New York 
Addison-Wesley, Reading, Massachusetts 
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Ph. D. Advisees; (names, title of dissertation, year of graduation, current 
position if known) 

Brian Lofy, “Segmenting and Matching of Aerial Images Acquired by Different 
Sensors,” 1999: Senior Engineer, Marconi Integrated Systems, San Diego, California. 

Eric Y. Tao, “Database-Aided Diagnosis in Digital Mammography,” 1998: Assistant 
Professor, Institute of Communication Science and Technology, California State 
University, Monterey Bay, California 

Mark Vriesen^ “Genetic design of pattern classifiers,” 1995: Senior Engineer, GDE 
Systems, San Diego, California. 

L. V. Tran, "Quantitative Biplane Angiography", 1991: Research Engineer, Northrop 
Corporation, Anaheim, California 

Y. Moon, "Multicomputer architectures for image analysis," 1990: Assistant 
Professor, Korea Academy of Industrial Technology, Seoul, Korea 

D. Gutfinger, "Mixed Adaptation -- a Theory for Designing Robust Classifiers," 1990: 
Student at UCI College of Medicine 

Y. Park, "Linear Tree Classifiers" 1990, Assistant Professor, Kyung Hee University, 
Suwon Campus,Yongin, Kyungkido, Korea 

W. W. Siedlecki, "Feature selection for large scale classifiers," 1988: Vice President 
for Research, P-Logic Corporation 

K. Kitamura, "Estimating the transverse areas and boundaries of coronary arteries in 
three dimensions," 1987: Research Engineer, Nippon Steel Corporation 

P. E. Chandler, "A multiple scattering model for pulse propagation within velocity 
inhomogeneous, lossy, and refinctive media," 1986 

T. V. Nguyen, "Three-dimensional reconstruction of the medial axes of coronary 
arteries fi’om single-view angiograms," 1986: President, Multisignal Technology 
Corporation; Professor, California State University, Long Beach, California 

I. Foroutan, "Feature selection for piecewise linear classifiers," 1985: Manager of 
Circuit Automation, Hughes Aircraft Co. 

M. Hashimoto, "Estimation of multiple-order derivatives for edge detection," 1984: 
member of Japan Defense Force 
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D. Petkovic, "A computer system for coarse-fme detection of pulmonary nodules in 
chest radiographs," 1983: Manager of Department of Advanced Algorithms, 
Architectures, and Applications, IBM Almaden Research Center 

L. A Ferrari, "Recursive binary-valued image filters," 1980: Associate Professor of 
Electrical and Computer Engineering, Chairman of Department of Electrical and 
Computer Engineering, UC Irvine 

E. J. Pisa, "Computing the geometry of the rib cage from two chest radiographs," 
1979: Vice President of Research and Development, Ivac Corporation 

H. Wechsler, "Automatic Detection of Rib Contours in Chest Radiographs," 1975: 
Professor of Computer Science, George Mason University 

D. H. Ballard, "Hierarchic Recognition of Tumors in Chest Radiographs," 1974: 
Professor of Computer Science, University of Rochester 

P. J. Nahin, "A parallel machine for describing and classifying silhouettes," 1972: 
Associate Professor of Electrical Engineering, University of New Hampshire 

P. M. Merryman, "Dynamics of multidimensional Markov learning," 1972: Senior 
System Engineer, Ultrasystems, Inc. 

G. N. Wassel, "Training a linear classifier to optimize the error probability," 1972: 
Professor of Electrical Engineering, Cal Poly University, San Luis Obispo, California 

H. R. Ramanujam, "A stopping rule for threshold learning," 1970: Principal Engineer, 
McDonnell Douglas Corp. 


M. S. Advisees: 

Chester J. Omes, “ A Neural Classifier for Database-Aided Decisions,” 1997. 

J. Ribas-Corbera, "Image Data Compress and hiterfirame Interpolation of Cinematic 
Sequences," 1992. 

M. R. Vriesenga, "Colored Illumination for Maximizing Contrast in Machine 
Vision," 1991. 

R. Agarwal, "Optical Flow from Clusters in Velocity Space," 1991. 

E. M Hertzberg, "Quantitative Analysis of Magnetic Resonance Images," 1991. 
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J. B. Bartels, "Analysis of Random and Systematic Errors in Ti Measurement with 
Gradient Echo Magnetic Resonance Imaging," 1990. 

S. R. Reuman, "Computing Albedo, Illumination, and Optical Flow with 
Spacetime-Adaptive Bandpass Filtering," 1988. 

J. J. EHiffy, "Time Varying System Feedback Design," 1988. 

N. Diev, "Failure Isolation in Linear Stochastic Systems - the Associative Recall 
Approach," 1987. 

R. F. DeShetler, "Finding the Polyhedra Formed by the Hyperplanes of a Piecewise 
Linear Classifier," 1986. 

N. P. DeMesa, "Petri Net Analysis," 1986. 

P. E. Chandler, "A Multiple Scattering Model for Pulse Propagation within Velocity 
Inhomogeneous, Lossy, and Refractive Media," 1986. 

S. V. Hung-Leo, "Computer-Aided Design of Multiple-Class Piecewise Linear 
Classifiers, 1983. 

F. Towfiq, "Piecewise Linear Detection of Curved Edges, 1980. 

M. D. McNeil, "Digital Preprocessing of Low Contrast, Wide Dynamic Range 
Images," 1975. 

T. Miyatake, "Compute-Film System for Contrast Enhancement," 1972. 

D. V. Smith, 'Dynamic Behavior of Time-Varying Threshold Learning Processes," 
1968. 


Visiting Scholars: 

Professor Minechi Kudo, Hokkaido University, Sapporo, Japan, 9 months, 1996. 

Professor Leon Bobrowski, Polish Academy of Science, Fulbri^t Scholar, Poland, 1 
year, 1994-1995. 

Oliver Paetz, RW Technische Hochschule, Germany, 10 months, 1994-1995. 

Matthias Kroemer, RW Technische Hochschule, 6 months, 1995-1996. 
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Ariela Kamin, Technion ~ Israel Institute of Technology, Israel 1990 -1991 

Akio Shio, Nippon Telegraph and Telephone Corporation, Japan - 1.5 years 1989- 
1991 

Professor Kalman Peleg, Technion - Israel Institute of Technology, Israel - 5 months, 
1990 

Professor Peter Jensch, The University of Oldenburg, West Germany -6 weeks, 1989- 
1990 

Ryuji Nishimura, Hitachi Ltd., Japan -1.5 years 1989 -1990 

Dr. Thomas Tolxdorff, Rheinisch-Westfalischen Technischen Hochscule, West 
Germany - 4 weeks, 1989 

Dr. Leon Bobrowski, Institute of Biocybemetics and Biomedical Engineering, 
Poland, 3 weeks, 1989 

Djordije Jankovic, Boris Kidric Institute, Yugoslavia - 3 months, 1989 
Professor Mirek Pawlak, The University of Manitoba, Canada - 2 months, 1989 
Hideaki Doi, Hitachi Ltd, Japan -1 year, 1988-1989 
Professor Adam Krzyzak, Concordia University, Canada -1 month, 1988. 

Extramural funding since 1987: 


PROGRAM TITLE 

DATES 

AGENCY 

MONETARY LEVEL 

Database-Aided 

Telemammography 

2000-02 

California Telehealth and 
Telemedicine Center 

$115,000 

Database-Aided Diagnosis 
in Digital Mammography 

1999-03 

U. S. Army Medical 
Research and Materiel 
Command 

$1,928,000 

Computer-Aided Diagnosis 
In Digital Mammography 

1997-99 

California Breast Cancer 
Research Program 

$214,000 

Biologically Inspired 
Intelligent Classifiers 

1992-96 

NSF 

$ 330,000 
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Landmark Detection 

1997-98 

Naval Air Warfare Center 

$25,000 

Line Detection and Genetic 

1995-96 

ONR 

$ 135,000 

Feature Selection 

Genetic Algorithms for 
Target Recognition 

1993-94 

Naval Air Warfare 

Center 

$ 20,000 

Digital Video for 

1993-94 

NSF 

$ 25,000 

Intelligent Systems 

Target Recognition 

1992-93 

UCMICRO/Loral 

$ 53,000 


Computer Vision 

1989-92 

NTT 

(Nippon Telegraph and 
Telephone Corporation) 

$ 120,000 

Automated Tissue 
Production 

1989-92 

BARD (Binational 
Agricultural Research 
& Development Fund) 

$ 129,000 

Neural Learning 

1989-91 

DARPA 

$ 300,000 

Image Processing 
Architectures 

1989-90 

Rockwell/Micro 

$ 34,000 

Computer Vision 

1988-90 

Hitachi 

$ 55,000 

Automatic Pattern 
Classification 

1987-90 

Army Research 
Office 

$ 140,000 

Discretionary 

Research 


Hughes Aircraft 

$ 10,000 
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Publications: 


Books: 


Pattern Classifiers and Trainable Machines (with G. Wassel), Springer-Verlag, 1981 


Books edited: 

1. Biomedical Images and Computers (co-edited with J. C. Bisconte), Springer-Verlag, 
Heidelberg, 1982. 

2. Proceedings of the Symposium on Computer-Aided Diagnosis of Medical Images 
(editor), IEEE Computer Society, November 1976. 

3. Pattern Recognition: Introduction and Foundations (editor), Dowden, Hutchinson, and 
Ross, Stroudsburg, PA, 1973. 


Book Chapters and Articles: 

1. "Large-Scale Feature Selection" (with W. Siedlecki), Handbook of Pattern Recognition 
& Computer Vision, edited by C.H. Chen, L.F. Pau, P.S.P Wang, World Scientific, 
1993, Chapter 1.3, pp. 61-123. 

2. "Biomedical Image Analysis" (with P. V. Sarikar and R. J. Walter), Handbook of 
Pattern Recognition and Image Processing, ed. by Young and Fu, Chapter 26, 
Academic Press, 1986. 

3. "Two-Resolution Detection of Lung Tumors in Chest Radiographs," (widi D. 
Petkovic), Multiresolution Image Processing, edited by A. Rosenfeld, Springer-Verlag, 
1983, pp. 365-378.1 

4. "The Use of Markov Random Fields as Models of Texture" (with Martin Hassner), 
Image Modeling, edited by A. Rosenfeld, Academic Press, 1980, pp. 185-198. Also: 
Computer Graphics and Image Processing, Vol. 12,1980, pp. 357-370. 

5. "Toward Computed Detection of Nodules in Chest Radiographs," Real Time Medical 
Image Processing, edited by M Onoe, K. Preston, Jr., A. Rosenfeld, Plenum Press, 
New York, 1980, pp. 53-59. 
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6. "Biomedical Image Analysis," Issues in Digital Image Processing, edited by R. M. 
Haralick and J. C. Simon, published by Sijthoflf and Noordhoff, Alphen, The 
Netherlands, 1980, pp. 291-311. 

7. "Image Segmentation and Feature Extraction," Digital Image Processing and Analysis, 
edited by J. C. Simon and A. Rosenfeld, NoordnofF International Publishers, 
Groningen, The Netherlands, 1977. 

8. "Boundary Detection in Medical Radiographs," Digital Processing of Biomedical 
Images, edited by K. Preston and M Onoe, Plenum Press, New York, 1976, pp. 
309-322. 

9. "Time-Var 3 dng Threshold Learning " Proceedings of 1966 Joint Automatic Control 
Conference, University of Washington, Seattle, Washington, August, 1966, pp. 33-37. 
Also: Cybernetic Problems in Bionics, ed. by HL. Oestreicher and D. R. More, Gordon 
and Breach Science Publishers, New York, 1968, pp. 687-695. 

Refereed journal articles: 

1. Brian Lofy, Jack Sklansky, “Segmenting Multisensor Aerial Images in Class-Scale Space,” 
Pattern Recognition, Vol. 34,2001, pp. 1825-1839. 

2. J. Sklansky, Eric Y. Tao, M. Bazargan, C.J. Omes, R.C. Murchison, S. Teklehaimanot, 
“Computer-Aided, Case-Based Diagnosis of Mammographic Regions of Interest Containing 
Microcalcifications,” ./Icat/emic Radiology, Vol. 7, No. 6, June 2000, pp. 395405. 

3. Kenneth R. Hofi6nannPh.D., Andreas Wahle Ph.D., Claire Pellot-ParakatPh.D., Jack Sklansky 
Eng.Sc.D., Milan Sonka, Ph.D., “Biplane Xray Angiograms, Intravascular Ultrasound, and 3D 
Visuali 2 ation of Coronary Vessels,” submitted to International Journal of Cardiac Imaging, July 
1999. 

4. C. Omes, J. Sklansky, “A Visual Neural Classifier,” IEEE Trans, on Systems, Man, and 
Cybernetics, Part B, Vol. 28, No. 4, August 1998, pp. 620-625. 

5. Chester Omes, Jack Sklansky, “A Neural Network that Visualizes What It Classifies,” Pattern 
Recognition Letters, Vol. 18, 1997, pp. 1301-1306. 

6. B-B Chai, T. Huang, X. Zhuang, Y. Zhao, J. Sklansky, “Piecewise linear classifiers using binary 
tree stmcture and genetic algorithm,” Pattern Reco^ition, Vol. 29 No. 11,1996, pp. 1905-1917. 

7. “ Genetic Selection and Neural Modeling of Piecewise Linear Classifiers” (with M. Vriesenga), 
International Journal of Artificial Intelligence and Pattern Recognition, August 1996. 

8. “Colored Illumination for Enhancing Discriminability in Machine Vision” (with M Vriesenga, 

G. Healey), Journal of Visual Communication and Image Representation, Vol. 6, No. 3, 
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September 1995, pp. 244-255. 


9. “Linear Classifiers by Window Training” (with L. Bobrowski), IEEE Transactions on Systems, 
Man and Cybernetics, Vol 25, No. 1, Jan. 1995, pp. 1-9. 

10. J. Sklansky, “Toward Quantitative Coronaiy Angiography,” Proceedings of the Japanese 
Association of Medical Imaging Technology, Vol. 12, No. 4, July 1994, pp. 295-305. 

11. “Reconstructing the 3-D Medial Axes of Coronary Arteries in Single-View Cineangiograms” 
(with T. V. Nguyen), IEEE Transactions on Medical Imaging, Vol. 13, No. 1, March 1994, pp 
61-73. 

12. “Interframe Interpolation of Cinematic Sequences” (with J. Ribas-Corbera), Journal of Visual 
Communication and Image Representation, Vol. 4, No. 4, December 1993, pp. 392-406. 

13. "Graph-based Thinning for Binaiy Images" (with S. Suzuki, N. Veda), International Journal of 
Pattern Recognition and Artificial Intelligence, Special Issue on Techniques for Thinning 
Digitized Patterns, 1993, pp. 1009-1030. 

14. L.V. Tran, R.C. Bahn, J. Sklansky, "Reconstructing the Cross Sections of Coronary Arteries from 
Biplane Angiograms", IEEE Trans, on Medical Imaging, Vol. 11, No. 4, Dec. 1992, pp. 517- 
529. 

15. "Flexible Mask Subtraction for Digital Angiography" (with L.V. Tran), IEEE Trans, on Medical 
Imaging, Vol. 11, No. 3, September 1992, pp. 407-415. 

16. "Robust Classifiers by Mixed Adaptation" (with D. Gutfinger), IEEE Transactions on Pattern 
Analysis and Machine Intelligence, Vol. 13, No. 6, June 1991, pp. 552-567. 

17. "Automated Design of Linear Tree Classifiers" (with Y. Pari;), Pattern Recognition, Vol. 23, No. 
12,1990, pp. 1393-1412. 

18. "A note on genetic algorithms for large-scale feature selection" (with W. Siedlecki) Pattern 
Recognition Letters, 1989, pp. 335-347. 

19. "Macropipelined multicomputer architecture for image analysis" (with Y. Moon, N. 
Bagherzadeh), Journal of the Optical Society of American A, 1989. 

20. "Automated design of multiple-class piecewise linear classifiers " (with Y. Park), Journal of 
Classification, 1989, pp. 195-222. 

21. "Mapping techniques for exploratory pattern analysis," (with W. Siedlecki and K. Siedlecka), 
Pattern Recognition and Artificial Intelligence, edited by E.S. Gelsema and L.N. Kanal, Elsevier 
Science Publishers B. V. (North-Holland), 1988, pp. 277-299. 
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22. "Bottlenecks to effective application of machine vision -- a discussion," Machine Vision: 
Algorithms, Architectures, and Systems, edited by H. Freeman, Academic Press, 1988, pp. 187- 
192. 

23. "Estimating the 3-D skeletons and transverse areas of coronary arteries from biplane 
angiograms," (with K. Kitamura), IEEE Transactions on Medical Imaging, September 1988, pp. 
173-187. 

24. "On automatic feature selection," (with W. Siedleckij, International Journal on Pattern 
Recognition and Artificial Intelligence, Vol. 2, No. 2, August 1988, pp. 197-220. 

25. "Overview of mapping techniques for exploratory pattern analysis," (with W. Siedlecki, K. 
Siedlecka), Pattern Recognition, Vol. 21, No.5, pp. 431-438,1988. 

26. "Experiments on mapping techniques for exploratory pattern analysis" (with W. Siedlecki, K. 
Siedlecka), Pattern Recognition, Vol. 21, pp. 431-438,1988. 

27. "Real-time scene imderstanding and vision automation - a brief overview," (with K. H. Kim), ed. 
by Francis J. Corbett, Proceedings ofSPIE — The International Society for Optical Engineering, 
Vol. 755, Image Pattern Recognition Algorithm Implementations, Techniques, and Technology, 
January 1987, pp. I26-13I. 

28. "Recursive algorithms for implementing digital image filters," (with L. Ferrari, P. V. Sankar, S. 
Shinnaka), IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-9, No. 
3, May 1987, pp. 461466. 

29. "Feature selection for automatic classification of non-Gaussian data" (with I. Foroutan), IEEE 
Trans, on Systems, Man, and Cybernetics, Vol. SMC-17, No. 3, March/April 1987, pp. 187-198. 

30. "Multiple-Order Derivatives for Detecting Local Image Characteristics," (with M. Hashimoto), 

Computer Vision, Graphics, and Image Processing, Vol. 39, 1987, pp. 28-55. 

31. "Computing the Skeleton of Coronary Arteries in Cineangiograms," (with T. Nguyen), 
Computers and Biomedical Research, October 1986, pp. 428444. 

32. "Efficient two-dimensional filters using B-spline functions," (with L. Ferrari, P. V. Sankar and S. 
Leeman), Computer Graphics and Image Processing, Vol. 35,152-169,1986. 

33. "Biomedical Image Analysis," (with P. V. Sa nka r and R. J. Walte^, Handbook of Pattern 
Recofftition and Image Processing edited by Young and K-S Fu, Chapter 26, Academic Press, 
1986, pp. 629-647. 

34. "Elimination of nonpivotal plane images from x-ray motion- tomograms,"(with S. Kawata), 
IEEE Transactions on Medical Imaging, Vol. Mi4, No. 3, September 1985. 
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35. "The relative neighborhood graph for mixed feature variables," (with M. Ichinqi, Pattern 
Recognition, Vol. 8, No. 2,1985, pp. 161-167. 

36. "A note on Duhamel Integrals and Running Average Filters," (with L.Ferrari), Computer Vision 
Graphics, and Image Processing, Vol. 29, pp. 358-360,1985. 

37. "Optimum feature selection by zero-one integer programming," (with M. Ichinoj, IEEE Trans, on 
Systems, Man, and Cybernetics, Vol. 14, October 1984, pp. 737-746. 

38. "A fast recursive algoritiim for binary balued two-dimensional filters" (with L. Ferrari), 
Computer Vision, Graphics and Image Processing, Vol. 26,292-302,1984. 

39. "Minimal Rectangular Partitions of Digitized Blobs," Computer Vision, Graphics, and Image 
Processing, (with L Ferrari, P.V. Sankar), Vol. 28, pp. 58-71,1984. 

40. "Circularly coded x-ray tomography," (with S. Kawata), Transactions of Applied Optics, Vol. 23, 
No. 10, May 15,1984. 

41. "Scan-along polygonal approximation for data compression of electrocardiograms," (with M. 
Ishijima. S. Shin, G. Hostetter), IEEE Trans, on Biomedical Engineering, November 1983, pp. 
723-729. 

42. "Two-resolution detection of lung tumors in chest radiographs," (with D. Petkovic), 
Multiresolution Image Processing, edited by A. Rosenfeld, Springer-Verlag, 1983, pp. 365-378. 

43. "Finding flie convex hull of a simple polygon," Pattern Recognition Letters, Vol. 1, December 
1982, pp. 79-83. 

44. "Undersampling errors in region-of interest tomography," (with P. V. Sankar and 0. Nalcioglu), 
IEEE Trans on Medical Imaging, Vol. MI-1, No. 3, Novemter 1982, pp. 168-173. 

45. "Digital and Cellular Convexity," (with Chul E. Kim), Pattern Recognition, Vol. 15, No. 5,1982, 
pp. 359-367. 

46. "The detection and segmentation of blobs in infrared images" (with L.G. Mino^, IEEE Trans, on 
Systems, Man, and Cybernetics, Vol. SMC-11, No. 3, March 1981, pp. 194-201. 

47. "Skeleton generation from x,y boundary sequences of biological objects" (with B. Shapiro, E. J. 
Vise), Con^mter Graphics and Image Processing, 1981, pp. 136-153. 

48. "The use of Maikov random fields as models of texture" (with IVfertin Hassner^, Image Modeling, 
edited by A. Rosenfeld, Academic Press, 1980, pp. 185-198. Also; Computer Graphics and Image 
Processing, Vol. 12,1980, pp. 357-370. 


15 




49. "Toward computed detection of nodules in chest radiographs," Real-time Medical image 
Processing, edited by M. Onoe, K. Preston, Jr., A. Rosenfeld, Plenum Press, New York, 1980, pp. 
53-59. 


50. "Biomedical image analysis," Issues in digital image processing, edited by R. M. Haralick and J. 
C. Simon, published by SijthofF and Noordhofif, Alphen, The Netherlands, 1980, pp. 291-311. 

51. "A gestalt-guided heuristic boundary follower for x-ray images of lung nodules" (widi P. V. 
Sankar), IEEE Trans, on Pattern Analysis and Machine Intelligence, Vol. PAMI-4, No. 3, May 
1982, pp. 326-331. 

52. "Locally trained piecewise linear classifiers," (with L. Michelotti^, IEEE Transactions on Pattern 
Analysis and Machine Intelligence, Vol. PAMI-2, No. 2, March 1980, pp. 101-111. 

53. "Fast polygonal approximation of digitized curves" (with V. Gonzalez), Pattern Recognition, 
Vol. 12, pp. 327-331, Pergamon Press, 1980. 

54. "Preprocessing of Electron Micrographs of Nucleic Acid Molecides for Automatic Analysis by 
Computer" (with L. Lipkin, P. Lemkin, B. Shapirq), Computers and Biomedical Research, Vol. 
12,1979, pp. 279-289. 

55. "Preprocessing of Electron Micrographs of Nucleic Acid Molecules for Automatic Analysis by 
Computer n. Noise Removal and Gap Filling," (with P. Lemkin, et al.) Computers and 
Biomedical Research, Vol. 12,1979, pp. 615-630. 

56. "On the Hough Technique for Curve Detection" IEEE Trans, on Computers, Vol. C-27, No. 10, 
October 1978, pp. 923-926. 

57. "Image Segmentation and Feature Extraction," IEEE Trans, on Systems, Man and Cybernetics, 
Vol. SMC-8, No. 4, April 1978, pp. 237-247. 

58. 'Tinding the Rib Cage in Chest Radiographs" (widi H. Wechsler), Pattern Recognition, 
Pergamon Press, 1977, Vol. 9, pp. 21-30. 

59. "A Theory of Nonuniformly Digitized Binary Pictures" (with D. F. Kibler) IEEE Trans, on 
Systems, Man and Cybernetics, Vol. SMC-6, No. 9, September 1976, pp. 636-647. 

60. "Variable Resolution Digital Perception" (with A Fam), invited paper fox Journal of Cybernetics 
and Information Science, Vol. 1, No. 1, Spring 1976, pp. 40-49. 

61. "A Ladder Structured Decision Tree for Recognizing Tumors in Chest Radiographs" (with D. H. 
Ballard), IEEE Trans, on Computers, Vol. C-25, No. 5, May 1976, pp. 503-515. 


16 



62. 'Tinding Circles by an Array of Accumulators" (with C. Kimme and D.H. Ballard) 
Communications of the ACM, Vol. 18, No. 2, Februaiy 1975, pp. 120-122. 

63. "On Filling Cellular Concavities," Computer Graphics and Image Processing, Vol. 4, June 1975, 
pp. 236-247. 

64. 'Parallel Detection of Concavities in Cellular Blobs" (with L. Cordelia and S. Levialdi), IEEE 
Trans, on Computers, Vol. C-25, No. 2, February 1976, pp. 187-196. 

65. "Adaptive Trackers Based on Continuous Learning Theory" (with N. J. Bershad and P. 
Merryman), IEEE Trans, on Aerospace and Electronic Systems, Vol. AES-10, No. 2, March, 
1974, pp. 245-254. 

66. "A Continuous Two-Dimensional Model of Threshold Learning" (with P. Menyman), IEEE 
Trans, on Systems, Man and Cybernetics, Vol. SMC-3, No. 1, January, 1973, pp. 51-61. 

67. "Tumor Detection in Radiographs" (widi D. H. Ballard), Computers and Biomedical Research, 
Vol. 6, No. 3, June 1973. 

68. "A Stopping Rule for Threshold Learning" (with H. R. Ramanujam), International Journal on 
Systems Science, Vol. 4, No. 1,1973, pp. 129-148. 

69. "A Parallel Mechanism for Describing Silhouettes" (with P. J. Nahin), IEEE Trans, on 
Computers, Vol. C-21, No. 11, November, 1972, pp. 1233-1239. 

70. "Measuring concavity on a rectangular mosaic," IEEE Trans, on Computers, Vol. C-21, No. 12, 
December 1972, pp. 1355-1364. 

71. "Training a One-Dimensional Classifier to Minimize the Probability of Error" (with G. Wassel), 
IEEE Trans. Systems, Man and Cybernetics, Vol. SMC-2, No. 4, September, 1972, pp. 533-541. 

72. A Stopping Rule for Trainable One-Dimensional Threshold Learning" (with H. R. Ramanujam) 
IEEE Trans, on Systems, Man and Cybernetics, Vol. SMC-2, No. 4, September, 1972, pp. 
553-557. 

73. "Minimum-Perimeter Polygons of Digitized Silhouettes" (with R. L. Chazin and B. J. Hansen), 
IEEE Trans, on Computers, Vol. C-21, No. 3, March, 1972, pp. 260-268. 

74. "Threshold Learning and Brownian Motion" (with N. J. Bershad), IEEE Trans, on Information 
Theory, Vol. IT-17, No.3, May, 1971, pp. 350-352. 

75. "Recognizing Three-Dimensional Objects by their Silhouettes" (with G. A. Davison), Journal of 
the Society of Photo-Optical Instrumentation Engineers, Vol. 10, No. 1, 
October-November-December, 1971, pp. 10-17. 
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76. "Threshold Convolution Operations," Journal of the Association for Computing Machinery, No. 
17, January 1970, pp. 161-165. 

77. "Recognition of Convex Blobs," Journal of the Pattern Recognition Society, Vol. 2, No. 1, 
January, 1970, pp. 3-10. 

78. "The Dynamics of Time-Varying Threshold Learning" (with N. J. Bershad), Information and 
Control, Vol. 15, No. 6, December 1969, pp. 455-486. 

79. "The Delay Method of Analyzing Markov Chains" (with K. R. Kaplan), SIAM Journal on 
Applied Math, November 1968. 

80. "A Formalism for Program Translation" (with M. Finkelstein and E.C. Russell), Journal of the 
Association of Computing Machinery, Vol. 15, No. 2, April, 1968, pp. 165-175. 

81. "Canonical Tributary Networks" (with A. J. Korenjak, H. S. Stone), IEEE Trans, on Electronic 
Computers, Vol. EC-14, December, 1967, pp. 961-963. 

82. "Learning Systems for Automatic Control," IEEE Trans, on Automatic Control, Vol. AC-11, No. 
1, January 1966, pp. 6-19. 

83. "Threshold Training of Two-Mode Signal Detection," IEEE Trans, on Information Theory, Vol. 
IT-11, No. 3, July 1965. 

84. "Adaptation, Learning, Self-Repair and Feedback," IEEE Spectrum, May, 1964, pp. 172-174. 

85. "Transients in Markov Chains" (with K. R. Kaplan), IEEE Trans, on Electronic Computers, 
December 1963, pp. 921-922. 

86. "General Synthesis of Tributary Switching Networks," IEEE Trans, on Electronic Computers, 
October, 1963, pp. 464-469. 

87. "Ultimate Speed Adders," IEEE Trans, on Electronics, Vol. EC-12, No. 2, April, 1963, pp. 
142-148. 

88. "Analog and Threshold Building Blocks for Variable-Radix Adders and Other Logic Networks," 
Trans. AIEE, Part 1, Communications and Electronics, July, 1961, pp. 289-295. 

89. "Conditional-Sum Logic," IRE Trans, on Electronic Computers, Vol. EC-9, No. 21, June 1960, 
pp. 226-231. Also: Computer Arithmetic edited by E.E. Swartzlander, Jr., Dowden, Hutchinson 
& Ross, Inc., Stroudsburgh, PA, U.S. A., 1980, pp. 57-62. 
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90. "An Evaluation of Several Two-Summand Binary Adders," IRE Tram, on Electronic 
Computers, Vol. EC-9, No. 2, June 1960, pp. 213-226. Also: Computer Arithmetic, edited by E. 
E. Swartzlander, Jr., Dowden, Hutchinson & Ross, Inc., Stroudsburg, PA, U.S.A., 1980, pp. 
63-76. 


91. "On Closed-Form Expressions for Mean Squares in Discrete- Continuous Systems," IRE Trans, 
on Automatic Control, Vol. PGAS-4, March, 1958, pp. 17-21. 

92. "Optimizing the Dynamic Parameters of a Track-While Scan Systems," RCA Review, June 1957, 
Vol. 18, No. 2, pp. 163-185. 

93. "Analysis of Errors in Sampled-Data Feedback Systems" (with J.R. Ragazzini), Tram. AIEE, Part 
2, Applications and Industry, May 1955, pp. 65-71. 

Refereed conference proceedings: 

^ Chester Omes, Daniel J. Valentino, Hong-Jun Yoon, Jack I. Eisenman, Jack Sklansky, 

“A Search Engine for Remote Database-Aided Interpretation of Digitized Mammograms," 
Proc. of the 2001SPIE Meeting on Medical Imaging, PACS and Integrated Medical 
Information Systems: Design and Evaluation, Volume 4323, February 2001. 

2. J. Sklansky, E.Y. Tao, C. Omes, A.C. Disher, “Visualizing a Database in Mammographic 
Screening,” Scientific Program of the 1998 Annual Meeting of the Radiological Society of 
North America, Chicago, December 1998. 

3. J. Sklansky, E. Y. Tao, C. Omes, A. C. Disher, “A Visualized Mammographic Database 
in Computer-Aided Diagnosis,” Computer-Aided Diagnosis in Medical Imaging, edited by 
K. Doi, H. McMahon, M. L. Giger, K.R. Hoffmann, Elsevier, Amsterdam, 1999, pp. 215- 
220 . 

4. J. Sklansky, E.Y Tao, C. Omes, A.C. Disher, “A neurodatabase system for mammographic 
screening,” Proceedings of 11^ IEEE Symposium on computer-based medical systems, ” June 
11-14,1998, Lubbock, Texas, USA, IEEE Computer Society, Los Alamitos, California, pp. 78- 
83. 

5. .E. Tao, C. Omes, J. Sklansky, “Automatic detection of microcalcifications in digital 
mammography,” Proceedings of SPIE Symposium on Medical Imaging,” February 1998. 

6. C. Omes, J. Sklansky, “A Visual Neural Network that Learns Perceptual Relationships,” 
Proceedings of International Conference on Pattern Recognition, Brisbane, Australia, August 
1998. 

7. J. Sklansky, E. Y. Tao, C. J. Omes, A. C. Disher, J. I. Eisenman, J. B. Swartz, “Database and 
Neural Network Help Mammographers Suppress Benign Biopsies and Detect Cancers,” Hot 
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Topics at 1997 RSNA Scientific Assembly; Radiology, Vol. 206, No. 2, Februaiy 1998, p. 575. 


8. C. Omes, J. Sklansky, “A Visual Multi-Expert Neural Classifier,” Proceedings of the 1997 
International Conference on Neural Networks, ” June 1997. 

9. Mineichi Kudo, Jack Sklansky, “A Comparative Evaluation of Medium- and Large-Scale 
Feature Selectors for for Pattern Classifiers,” Proceedings of the lAPR 2nd International 
Workshop on Statistical Techniques in Pattern Recognition, ” June 1997. 

10. C. Omes, J. Sklansky, “A Neural Network that Explains as Well as Predicts Financial Market 
Behavior, Proceedings of the lEEE/IAFE Conference on Computational Intelligence for 
Financial Engineering, March 1997. 

11. Eric Y. Tao, Jack Sklansky, “Analysis of mammograms aided by database of images of 
calcifications and textures,” Medical Imaging 1996: Image Processing, SPIE—The International 
Society for Optical Engineering, Vol. 2710, pp.988-995. 

12. Brian Lofy, Oliver Patz, Mark Vriesenga, Johannnes Bemarding, Klaus Haaibeck, Jack 

Sklansky, “Landmark Enhancement by Spoke-Directed Anisotropic Diffusion,” Mapping 
Buildings, Roads and other Man-made Structures from Images, Proceedings of the lAPR TC-7 
Workshop “Remote Sensing and Mapping,” Graz, Austria, September 1996, pp. 103-117. 

13. ‘Xinear Classifiers by Window Training and Basis Exchange” (with Leon Bobrowski), 

Proceedings of the 12th International Conference on Pattern Recognition, IEEE Computer 
Society, October, 1994, 

14. “Toward Quantitative Coronary Angiography,” Proceedings of the Japanese Association of 
Medical Imaging Technology, Vol. 12, No. 4, July 1994, pp. 295-305. 

15. “Automated Motion Estimation fi-om M-Mode Echocardiograms” (with R. Close, J. S. Whiting, 
S. Tamura), Proceedings of the SPIE Conference on Mathematical Methods in Medical 
Imaging, July 24-29,1994, San Diego, California. 

16. "Estimating optical flow for large interfiame displacements" (with R.A Agarwal), Computer 
Analysis of Images and Patterns, edited by D. Chetverikov, W.G. Kropatsch, Springer-Verlag, 
Berlin, 1993, pp. 403411. 

17. "Interpolation of Cinematic Sequences" (with J. Ribas-Corbera), Proceedings of IEEE 
Workshop on Application of Computer Vision, IEEE Computer Society, November 1992. 

18. "Computational Discovery for Nonlinear Classifiers", 1992 IEEE International Conference on 
Systems, Man, and Cybernetics, IEEE Systems, Man, and Cybernetics Society, October 1992, 
pp. 1309-1313. 
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19. "Extracting Nonrigid Moving Objects by Temporal Edges" (with S. Suzuki), Proceedings of 11th 
International Conference on Pattern Recognition, Vol. I, pp. 69-73, IEEE Computer Society 
Press, September 1992. 

20. "Estimating Optical Flow from Clustered Trajectories in Velocity-time" (with R. Agarwal), 
Proceedings of 11th International Conference on Pattern Recognition, IEEE Computer Society 
Press, Vol. I, pp 215-219, September 1992. 

15. "Multiresolution Method for Reconstructing the Cross Sections of Coronary Arteries from 
Biplane Angiograms" (with R. Wang), Proceedings of 11th International Conference on Pattern 
Recognition, IEEE Computer Society Press, September 1992, Vol. HI, pp. 667-670. 

16. M. Vriesenga, G. Healey, J. Sklanslg^, “Colored Illumination for Discriminating Objects,” 
IEEE Conference on Computer Vision and Pattern Recognition, 1992. 

17. "Colored Illumination for Enhancing the Discriminability of Objects" (with M. Vriesenga, G. 
Healey, K. Peleg, F. HoflSnan), Proceedings of the 8th Israeli Symposiim on Artificial 
Intelligence and Compiler Vision, December 1991, Computer Vision Section, pp. 181-191, 
published by Information Processing Association of Israel, Jerusalem, 1991. 

18. "Segmentation of People in Motion" (with Akio Shict), Proceedings of the IEEE Workshop on 
Visual Motion, IEEE Computer Society, October 1991, pp. 325-332. Also: Journal of the 
Information Processing Society of Japan - Special Interest Group Reports, Vol. 91, Report 
No. CV75-5, November 22,1991. 

19. 'Robust Curve Detection by Temporal Geodesics" (with D. Gutfinger, R. Nishimura, H Doi), 
Computer Analysis of Images and Patterns, edited by Reinhard Klotte, Proceedings of the IVth 
International Conference CAIP '91, Dresden, Germany, Sptember 17-19, 1991, pp. 72-76, 
published by Akademic Verlag GmbH, Berlin, 1991 (reprinted, with permission from IEEE, 
from Proceedings of the 3rd Intemational Conference on Computer Vision, Osaka, Japan, 
December 1990, pp. 752-756). 

20. "Tissue Identification in MR Images by Adaptive Cluster Aanalysis" (with D. Gutfinger, E. 
Hertzberg, T. Tolydorff, F. Greensite), SPIE Proceedings, Medical Imaging V: Image 
Processing, Vol. 1445,1991, pp. 288-296. 

21. 'Tast Tree Classifiers" (with Y. Park), Proceedings of the lOth Intemational Joint Conference on 
Pattern Recognition, Atlantic City, June 1990, published by IEEE Computer Society. 

22. "A class of mapping algorithms for hypercube computers" (with Y. Moon), Proceedings of the 
5th Distributed Memory Computing Conference, Charleston, South Carolina, April 1990, 
published by IEEE Computer Society. 
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23. "Toward reconstructing the cross sections of coronary arteries from biplane angiograms," 
Computer Applications to Assist Radiology, Symposia Foundation, Carlsbad, California, 1990, 
pp. 574-583. 

24. "Automated design of piecewise linear classifiers multiple-class data," (with Y. Park) 
Proceedings of 9th International Conference on Pattern Recognition, Rome, Italy, 1988, pp. 
1068-1071. 

25. "Dynamic belief systems for real-time decision making," (with D. Gutfmger, L. Bradford, G. 
Roberts) Proceedings of Third Annual Conference and Exhibition Conference on Expert 
Systems Solutions in Manifacturing, Detroit, Michigan, April 1989, pp. 353-371. 

26. "A note on genetic algorithms for large scale-feature selection," (with W. Siedlecki), Pattern 
Recogntion Letters, Vol. 10, NO. 5,1989, pp.335-347. 

27. "Constrained genetic optimization via dynamic reward-penalty balancing and its use in pattern 
recognition," (with W. Siedlecki), Proceedings of the Third International Conference on 
Genetic Algorithms, Morgan Kaufinann Publishers, San Mateo, California, June 1989, pp. 141- 
150. 

28. "Subpixel flexible registration for quantitative angiography," (with L. Tran) CAR'89, 
Computer-Assisted Radiology, edited by H. V. Lemke et al. Springer-Verlag, 1989. 

29. "Automatic detection and tracking of coronary artery skeletons in angiographic images," with S. 
Akamatsu), Pattern Recognition and Artificial Intelligence, edited by E. S. Gelsema and L. N. 
Kanal, Elsevier Science Publishers B. V. (North-Holland), 1988, pp. 277-299. 

30. "Estimating the 3-D skeletons and transverse areas of coronary arteries from biplane 
angiograms," (with K. Kitamura), IEEE Transactions on Medical Imaging, September 1988, pp. 
173-187. 

31. "On automatic feature selection," International Journal on Pattern Recognition and Artificial 
Intelligence (with W. Siedlecki), Vol. 2, No. 2, August 1988, pp. 197-220.128. 

32. "Automated design of piecewise linear classifiers of multiple-class data," (with Y. T. Park) 
Proceedings of Ninth International Conference on Pattern Recognition, Rome, 1988, pp. 
1068-1071. 

33. "Flexible mask subtraction for digital angiography," (with L.V. Tran) in Hybrid Image and 
Signal Processing, edited by D. P. Casasent, A.G. Tescher, Proceedings ofSPIE, Vol. 939, April 
1988, pp. 203-21. 


22 




34. "Assignment of tasks to multiple processors for image processing," (with Y. Moon, N. 
Bagherzadeh) Proceedings of Army Conference on Pattern Recognition for Advanced Missile 
Systems, 1988. 

35. "Biplane analysis of atheromatous coronary arteries," (wilh K. Kitamura, J.M. Tobis), 
Proceedings of Ninth International Conference on Pattern Recogyiition, Rome, 1988, 
pp. \211-m\. 

36. "Bottlenecks to effective application of machine vision - a discussion," Machine Vision: 
Algorithms, Architectures, and Systems, edited by H. Freeman, Academic Press, 1988, pp. 
187-192. 

37. "Real-time scene understanding and vision automation ~ a brief overview," (with K. K Kim), 
edited by Francis J. Corbett, Proceedings of SPIE — The International Society for Optical 
Engineering, Vol 755, Image Pattern Recognition: Algorithm Implementations, Techniques, 
and Technology, January 1987, pp. 126-131. 

38. "Three-dimensional reconstruction of the medial axes of coronary arteries from 
single-viewpoint cineangiograms," (with T. Nguyen) Proceedings of International Symposium 
CAR'87, Computer Assisted Radiology, edited by H. U. Lemke, et. al., Springer-Verlag, 1987, 
pp. 764-768. 

39. "Recursive algorithms for implementing digital image filters," (with L. Ferrari, P. V. Sankar, S. 
Shiimaka), IEEE Trans, on Pattern Analysis and Machine Intelligence, PAMI-9, No. 3, pp. 
461466, May 1987. 

40. 'Teature selection for automatic classification of non-Gaussian data (with I. Foroutan), IEEE 
Trans, on Systems, Man, and Cybernetics, Vol. SMC-17, No. 3, March/April 1987, pp. 187-198. 

41. "High speed image processing algorithms and architecture for medical applications," (with L. 
Ferrari, et al). Proceedings of International Symposium CAR'87, Computer Assisted Radiology, 
edited by H.U. Lemke et al.. Springer Verlag, 1987, pp. 744-748. 

42. "A fast skeleton-finder for coronary arteries,"(with T. V. Nguyen), Proceedings of Eighth 
International Conference on Pattern Recognition, Paris, France, 1986, pp. 481483. 

43. "Automatic feature selection for classification of non-Gaussian data," (with I. Foroutan), 
Proceedings of Eighth International Conference on Pattern Recognition, Paris, France, 1986, 
pp. 327-329. 

44. "Estimating the x-ray intercepted areas and boundaries of coronary arteries," (with K. Kitamura, 
and J. M. Tobis), Proceedings of Eighth International Conference on Pattern Recognition," 
Paris, France, 1986, pp. 478480. 
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45. "Efficient two-dimensional filters using B-spline functions" (with L. Ferrari, P. V. Sankar and S. 
Leeman), Computer Vision, Graphics, and Image Processing, Vol. 35,152-169,1986. 

46. "Feature selection for linear classifiers," (with M. Ichino) Proceedings of the IEEE Seventh 
International Conference on Pattern Recognition, July 30-August 2, 1984, Montreal, Canada, 
pp. 124-127. 

47. "A parallel multimicroprocessor architecture for image processing, (with Lee-Ming Chen), 
Proceedings of1984 International Conference on Parallel Processing, pp. 185-192. 

48. "Edge detection by estimation of multiple-order derivatives," (with M. Hashimoto^, Proceedings 
of1983 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 
1983. 

49. "Deblurring and three-dimensional reconstruction from multiple linear motion tomograms," 
(with S. Kawata), Proceedings of1983 Optical Society of America Topical Meeting on Signal 
Recovery and Synthesis with Incomplete Information and Partial Contraints, Lake Tahoe, 
Nevada, January 1983, pp. FAlO-1 to FAlO-5. 

50. "Detecting the edges of lung tumors by classification techniques" (with M. Hashimoto, P. V. 
Sankar), Proceedings of Sixth International Conference on Pattern Recognition, Munich, 
Germany, 1982, pp. 276-279. 

51. "Digital and Cellular Convexity," (with Chul E. Kim), Proceedings of the 1981 IEEE Computer 
Society Conference on Pattern Recognition and Image Processing, pp. 156-161. 

52. "Perspective-insensitive matching of planar arrays of points," (with J.F. Gilmore, P. V. Sankar, 
A. J. Spiessbach), Proceedings of the 1982 Computer Society Conference on Pattern 
Recognition and Image Processing, Las Vegas, Nevada, Jxme 1982, pp. 685-687. 

53. "A Gestalt-guided heuristic boimdaiy follower for x-ray images of lung nodules" (with P. V. 
Sankar), Proceedings of the Thirteenth International Conference on System Sciences, Vol. 2, 
January 1980, pp. 360-367. 

54. "Circular-coded x-ray tomography for recording and reconstmction of three-dimensional 
structures" (with S. Kawata), Proceedings of the VII International Conference Information 
Processing in Medical Imaging, June 1981. 

55. "Three-dimensional recording on a single film by a circular x-ray source" (with S. Kawata), 
Proceedings of the Society Proceedings of the Society of Photographic Scientists and Engineers 
Conference, Tucson, Arizona, January 1981, pp. 139-142. 
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56. "Piecewise Linear Detection of Boundaries in Chest Radiographs,"(with F. Towfiq), 
Proceedings of the 5th International Conference on Pattern Recognition, December 1980, pp. 
592-595. 

57. "Minimal Rectangular Partitions of Digitized Blobs" (with L. Ferrari and P. V. Sankar), 
Proceedings of the 5th International Conference on Pattern Recognition, December 1980, pp. 
1040-1043. 

58. "Medical radiographic image processing and pattern recognition," Proceedings of the 5th 
International Conference, IEEE Computer Society, Vol. 1, December 1980, pp. 374-382. 

59. "Applications of Pattern Recognition in Radiology," Proceedings of Second Symposium on 
Computers in Radiology, Amsterdam, June 1980. 

60. "Digital analysis of x-ray radiographs," Proceedings of US- France Seminar on Biomedical 
Image Processing, St. Pierre de Chartreuse, May 1980. 

61. "A Gestalt-guided heuristic boundary follower for x-ray images of lung nodules," (with P. V. 
Sankar), Proceedings of the Thirteenth International Conference on System Sciences, Vol. 2, 
January 1980, pp. 360-367. 

62. "The Use of Markov Random Fields as Models of Texture" (with M. Hassner), Proceedings of 
National Science Foundation Workshop on Image Modeling, Academic Press, 1980. 

63. "Multiple-Class Piecewise Linear Trainable Classifiers," Proceedings of the MCOM Workshop 
on Imaging Trackers and Autonomous Acquisition, November 1979, pp. 55-72. 

64. "Digital Measurements of Prominent Ducting in Mammograms," (coauthors: C. Kimme-Smith, 
G. Wassel, G. Frank!), Proceedings of the 32nd Annual Conference on Engineering in Alliance 
for Engineering in Medicine and Biology, October 1979, page 139. 

65. "Skeletons fi'om Sequential Boundary Data," (with B. Shapiro, J. Pisa), Proceedings of the 1979 
IEEE Computer Society. 

66. "Fast polygonal approximation of digitized curves" (with V. Gonzalez), Pattern Recognition, 
Vol. 12, pp. 327-331, Pergamon Press, 1980 also: Proceedings of1979 IEEE Computer Society 
Conference on Pattern Recognition and Image Processing, August 1979, pp. 604-609. 

67. "Toward Computed Detection of Nodules in Chest Radiographs," (with P. Sankar, M. Katz, F. 
Towfiq, D. Hassner, A. Cohen, W. Root), 1979 IEEE Computer Conference on Pattern 
Recognition and Image Processing, August 1979, pp. 484-487. Also, Proceedings of IEEE 
Computer Society Conference on Computer — Aided Analysis of Radiological Images, Newport 
Beach, California, June 1979, pp. 249-252. 
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68. "Toward Reliable Measurements of Breast Parenchymal Patterns," (with C. Kimme-Smith, G. 
Fiankl, G. Wassel), Proceedings of American College of Radiology, Sixth Conference on 
Computer Applications in Radiology, Newport Beach, California, June 1979, pp. 118-121. 

69. "Markov random field models of digittzed image textures," (with M. Hassner), Proceedings of 
Fourth International Joint Conference on Pattern Recognition, International Association for 
Pattern Recognition, Kyoto, Japan, November 1978, pp. 538-540. 

70. "Minimal Piecewise Linear Classifiers" (with L. Michelotti), Proceedings of Fourth 
International Joint Conference on Pattern Recognition, International Association for Pattern 
Recognition, Kyoto, Japan, November 1978, pp. 230-232. 

71. "Markov Random Field Models of Textured Images," (with Martin Hassner), Proceedings of the 
IEEE Computer Society Conference on Pattern Recognition and Image Processing, Jxme 1978. 

72. "Target Pattern Correlation for BMD Threat Discrimination, (with Hightower, K. J. Rowe), 
Proceedings of the Twenty-Third Annual Tri-Service Radar Symposium, West Point, New York, 
July 13,1977 (Classified SECRET). 

73. "Medical Visual Information Processing at the University of California at Irvine," Proceedings 
of the Third Annual AIM Workshop, Rutgers University, Laboratory for Computer Science 
Research, New Brunswick, New Jersey 09803, July 1977, page 13. 

74. "Parallel Detection of Concavities in Cellular Blobs" (with L. Cordelia and S. Levialdi), 
Proceedings of the Second International Joint Conference on Pattern Recognition, 
Copenhagen, August 1974, pp. 143-147. 

75. "Automatic Detection of Suspicious Abnormalities in Breast Radiographs" (with C. Kimme and 
B.J. OLoughlin), Proceedings of the Corrference on Computer Graphics, Pattern Recognition 
and Data Structure, May 14-16,1975, pp. 84-88. 

76. "Automatic Detection of Suspicious Abnormalities in Breast Radiographs" (with H. Wechsler), 
Proceedings of1975 San Diego Biomedical Symposium, February 1975, pp. 193-198. 

77. "Finding Candidate Tumor Sites in Radiographs with an Accumulator Array" (with C. Kimme 
and D.H. Ballard), Proceedings of San Diego Biomedical Symposium, Vol. 13,1974, pp. 415-420. 

78. "Hierarchic Recognition of Tumors in Chest Radiographs" (with D. H. Ballard), Proceedings of 
Second International on Pattern Recognition, Copenhagen, August 1974, pp. 258-263. 

79. "Adaptive Trackers Based on Continuous Learning Theory" (with N. J. Bershad and P. 
Merryman), Proceedings of the Sixth Hawaii International Conference on System Science, 
University of Hawaii, Honolulu, January, 1973. 
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80. "Stability of Threshold Learning," Proceedings of the 1971 IEEE Conference on Decision and 
Control, Miami Beach, Florida, December 1971. 

81. "Training a One-Dimensional Classifier to Minimize the Probability of Error" (with G. Wassel), 
1971 IEEE Conference on Decision and Control, Miami Beach, Florida, December, 1971. 

82. "A Parallel Mechanism for Describing Silhouettes" (with P. J. Nahin), IEEE Trans, on 
Computers, Vol. C-21, No. 11, November, 1972, pp. 1233-1239. Also: "A Parallel Mechanism for 
Recognizing Silhouettes," Proceedings ofIFIP Congress 71, August 1971. 

83. "Recognizing Three-Dimensional Objects by their Silhouettes" (with G. A. Davison), 
Proceedings of the XXXlst Avionics Panel Technical Meeting on Artificial Intelligence, Rome, 
Italy, May, 1971. 

84. "A Continuous Two-Dimensional Model of Discrete One-Dimensional Threshold Learning," 
(with P. Menyman) Proceedings of the 1970 IEEE Symposium on Adaptive Processes, 
December, 1970. 

85. A Stopping Rule for Trainable One-Dimensional Threshold Learning" (with H. R. Ramanujam) 
Proceedings of the 1970 IEEE Symposium on Adaptive Processes, December, 1970. 

86. "Markov Chain Model of Adaptive Signal Detection," 1963 Bionics Symposium, Contributed 
Paper Preprints, Dayton Ohio, htoch 20,1963. 

87. "Adaptation and Feedback," Proceedings of the 1962 Joint Automatic Control Conference, 
published by the American Institute of Electrical Engineers, 345 East 47th Street, New York, 
New York 10017. 

88. The Application of Feedback Concepts to the Incorporation of Learning in Complex Machine 
Systems," Proceedings of the Pilot Clinic on the Impact of Feedback Control Concepts on the 
Study of Economic and Business Systems, New York University, October 28,1960. Published 
by the Foundation for Instrumentation Education and Research, Inc., 345 East 47th Street, New 
York, New York. 

89. "Pulsed RC Networks for Sampled-Data Systems," IRE Convention Record, Part 2, Circuit 
Theory, 1956, pp. 81-99. 
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Technical Reports 

1. "An Image Storage Tube Computer," AD658521, Defense Documentation Center, 
Cameron, West Virginia, July, 1967. 

2. "Analysis of Markov Chain Models of Adaptive Processes" (with KR. Kaplan) 
Aerospace Medical Research Laboratories, Wright- Patterson Air Force Base, Ohio, 
Technical Report No. AMRL-TR-65-3, January, 1965. 

3. Two-Mode Threshold Learning," Aerospace Medical Research Laboratories, 
Wright-Patterson Air Force Base, Ohio, Technical Documentary Report No. 
AMRL-TR0-64-39,May, 1964. 

4. Network Compensation of Error-Sampled Feedback Control Systems, "Technical 
Report T-7/B, Electronics Research Labs., Columbia University, 632 West 125th Street, 
New York, 27, New York, April, 1955 (doctoral dissertation). 


Popular Literature Articles: 

1. "Trainable Systems," I.E.E.E. Student Journal, Vol. 5, No. 6, November, 1967, pp. 
16-22. 

2. "Adaptation Theory - A Tutorial Introduction to Current Research," Medical 
Electronics and Biological Engineering, RCA Publication PE238, RCA Laboratories, 
Princeton, New Jersey, 1965. 


Ph. D. Dissertation: "Network Compensation of Error-Sampled Feedback Control Systems," 1955. 

Public Lectures: 

Radiological Society of North America, “Hot Topics” paper, 1997 
UCI, Department of Electical and Computer Engineering, 1997 
King-Drew Medical Center, Invited Seminar, 1997 
UCI, Department of Medicine, Seminar, 1996 
UCI, Department of Radiological Sciences, Seminar, 1992 
UCI, Department of ECE, Annual Review of Research 1990 
University of Nebraska, EE Colloquium, Invited talk 1990 
IEEE Computer Society, Orange County Chap. Invited talk.1990 
Office of Naval Research Conf, St. Petersburg, Invited talk 
Symposium for Computer Assisted Radiology, Anaheim, CA, Invited talk 
2nd Conf of Int. Fed. of Classification Societies, Invited lecture 1989 
Technical University, Aachen, W. Germany Invited lectures, 1989 
Department of Psychiatry and Human Behavior, Invited lecture 1989 
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Second Conference of the Inti. Fed. of Classification of Societies, Invited talk, 1989. 
use. Invited talk, 1989 

Veterans Adm. Med. Center Radiolo©^ Dept. Long Beach 1989 

CAR'89 Third Inti. Symposium on Computer Assisted Radiology, West Berlin, Invited 
lecture 

UCI Dept, of Psych, and Human Behavior, Invited lecture 1988 
use Signal and Image Proceedings Institute, Invited lecture 1988 
UCI Department of Radiological Sciences, Invited lecture 1988 
VA Medical Center, Long Beach, CA, Invited lecture 1988 
Technion, Israel Inst, of Technology, Invited lectures, 1987 
GTE Government Systems Corporation, Invited lecture, 1987 
George Washington University, Invited lecture, 1987 
SPBE, International Soc. for Optic Engr. Invited lecture 1986. 

Patents; 

J. SkianslQ^, R. L. Thomason, "Electronic Inspection Systems and Methods of Inspection," 
US. Patent No. 4817184, March 28,1989. 

J. Sklansky, E. Vendrovsky, “Method and Apparatus for Video Data Compression,” US. 
Patent No. 6008851, Dec. 28,1999. 

Patent application: 

C. Omes, J. Sklansky, “Visual Neural Classifier,” U. S. Patent Application Serial No. 
09/272.697, filed on March 18,1999 by the Regents of the University of California. 


Courses Taught: 

Digital Signal Processing, graduate course, 1987-91 
Medical Imaging Systems, graduate course, 1989-1994 
Digital Signal Processing, undergraduate course, 1989-1992 
Intelligent Machines, gradimte course, 1966-1994 

Logic and Organization of Digital Computers, undergraduate course, 1966-1988 
Discrete Systems Theory, graduate course, 1975-1984 
Digital Image Analysis, graduate course, 1970-1984 
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Computer Vision, undergraduate course, Spring 1984 

Computer Architecture and Microprogramming, graduate course, 1975-1980 




University Service: 
1996-1998: 
1992-1993: 

1992-1993: 

1989-1990: 

1991-1992: 

1991-1992: 

1990: 

1990: 

1989: 

1989: 

1988-1989: 

1988-1989: 

1988-1989: 

1988-1989: 

1988-1989: 

1988: 


Chairman of UCI Emeriti Association Wel&e Committee 

Chair of Department Committee to evaluate a faculty promotion to 
Associate Professor with tenure 

Chair of Ad Hoc Senate Committee to review a faculty advancement. 

Chairman of Engineering Committee to Search for Chair of Department of 
Electrical and Computer Engineering 

Department of Electrical and Computer Engineering Committee to Search 
for faculty in circuits and systems 

School of Engineering Executive Committee 

Ad Hoc Committee for evaluating promotion to Associate Professor with 
tenure. 

Ad Hoc Committee for evaluation of advance to Professor Step VI 

Member of Ad Hoc Committees for reviewing merit increases for Assistant 
Professors 

Chair of Ad Hoc Committee to review promotion to Associate Professor 
wilh tenure 

Search Committee for senior computering faculty 
Search Committee for senior systems engineering faculty 
Computer Committee of School of Engineering 
Senate Review Committee for Regents Lecturers and Professors 
Chair of Affirmative Action for Department of Electrical Engineering 
Electrical Engineering Committee on Policy for Adjunct Professorships 
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1987: 

1987-1988: 

1987: 

1986-1988: 

1986-1987: 

1985-1986: 

1985: 

1985-1986: 

1985-1987: 

1985: 

1984-1987: 

1984: 

1984: 

1984: 

1984-1985: 

1984-1985: 

1984: 

1983: 

1983: 


Delegate of School of Engineering to California Engineering Foundation 
Conference 

Member of Executive Committee of Academic Senate 
Reviewer of research proposals to UC MICRO 
Delegate to Academic Assembly 

Chairman of Senate Ad Hoc Committee for evaluation of merit increase to 
Professor Step VI 

Electrical Engineering Committee on Graduate Curriculum and Graduate 
Requirements 

UC Systemwide Committee to Review the Multicampus Institute on 
Transportation Studies 

Engineering Committee on Procedures for Evaluation of Faculty 
Advancement 

Chairman of Computer Engineering Faculty Search Committee 
Chairman of Electrical Engineering Planning Committee 
Director of Focused Research Program on Image Engineering 

Electrical Engineering Graduate Studies Committee; editor of graduate 
studies brochure 

Electrical Engineering Academic Planning Committee 
Academic Planning Council of The Vice Chancellor 
Chair of Senate Committee on Planning and Budget 
Chair of Engineering Faculty 
ICS/Engineering Research Building Committee 
Electrical Engineering Graduate Studies Committee 
Executive Committee of Faculty of Engineering 
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1983: 

1982-1983: 

1982-1985: 

1977-1980: 

1980: 


1980-1982: 

1981: 

1981: 

1980-1988: 

1977-1978: 

1977: 

1976: 

1975-1977: 

1975: 

1974: 

1974: 

1974: 

1974: 


Senate Ad Hoc Committee to evaluate a proposed promotion to Professor 

Committee for evaluating major merit increases for three senior faculty 
members 

Graduate Committee of Department of Radiological Sciences 

Advisory Cabinet for Vice Chancellor of Academic Affairs 

University-wide committee for planning the use of Governor Brown's 4- 
million-dollar special fimd for engineering and computer science. 
Appointed by Academic Vice President William R. Frazer 

Chairman of recruiting computer engineering faculty 

Senate Special Committee to Review the Student Recommended Faculty 
Program 

Senate Ad Hoc promotion committee 

Faculty advisor to Chi Epsilon Mu and its successor, Tau Beta Pi, the 
national engineering honor society 

University Coordinating Committee on Graduate Affairs 

Review of patent disclosure for UC office of the Board of Patents 

Member of Engineering Dean's Task Force for Organizational Change 

Chairman of Graduate Council 

Chairman of Ad Hoc Committee for review of a faculty promotion 
Steering Committee of UCI Faculty Association 
Senate Committee on Compirter Policy 
Executive Committee of Engineering Faculty 

Chairman of Graduate Council Committee to Review the Graduate 
Program of die School of Biological Science (the first review of a graduate 
program at UCI) 
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1970: 

1969-1970: 


Chaimian of Applied Physics and Monnation Science group in the School 
ofEngineering 

Senate Committee on Computer Policy 
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